Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 32 Topics
  • 165 Replies

32 Topics

S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
published in Open Industrial Data

OpenID Connect on Open Industrial Data

OpenID Connect is now available on Open Industrial Data (OID). When you sign up to Cognite Hub, you get an account for the Open Industrial Data project.Whether you are new to OID or have been using API keys to access the data in this project, here’s all you need to get started with OIDC.Details to create the Cognite client when using Postman and Python SDK Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - 1b90ede3-271e-401b-81a0-a4d52bea3273, project=publicdata, CDF_CLUSTER - api App name: OID-Api Note: This app registration is configured with replyURLs for Postman and to run locally in http/https.  This app registration is configured with localhost to run python SDK apps locally with http/htpps. Details to create the cognite client when using JavaScript applications Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - dea6bb8d-0f48-4bf0-a469-176fc19edc14, project=publicdata, CDF_CLUSTER - api App name: OID-js Note: This app registration is configur

14996
Madina Kholmatova
Seasoned Practitioner
10 months ago
Eniko Farkas
Seasoned Practitioner
Eniko FarkasCognite Academy Instructor
published in Open Industrial Data

What is Open Industrial Data?featured

Hi, I’m Enikö Farkas from Cognite. With my team, we create e-learning for Cognite Academy. In our courses, we put a lot of emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data.In most of our courses, the training data we use comes from the Open Industrial Data (OID) project which is the result of a collaboration between Aker BP, one of Europe’s largest independent oil companies, and Cognite. While the data is from the oil and gas industry, its relevance is much broader: it gives us insight into dynamic industrial processes and can inspire all industries.In this article, I’m excited to share more about this project.About the dataThe data originates from a single compressor on Aker BP’s Valhall oil platform in the North Sea. Aker BP selected the first stage compressor on the Valhall because it is a subsystem with clearly defined boundaries, rich in time series and maintenance data.AkerBP uses Cognite Data Fus

10660
Eniko Farkas
Seasoned Practitioner
1 year ago
majofoal
Practitioner
majofoalPractitioner
posted in Open Industrial Data

How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

6
Eniko Farkas
Seasoned Practitioner
4 months ago
A
Committed
arianCommitted
asked in Open Industrial Data

Client id for the Python-SDK

Hello,I have a Python project that uses publicdata project of Open Industrial Data. I am trying to refactor the authentication step to use Python-SDK with OAuth since the API keys are (being) deprecated.To do so, I need the parameters token_url, client_id, client_secret, scopes.I am setting the parameters as such:cognite_tenant_id = "48d5043c-cf70-4c49-881c-c638f5796997"token_url=f"https://login.microsoftonline.com/{cognite_tenant_id}/oauth2/v2.0/authorize"client_id=???client_secret=<client secret generated from Open Industrial Data https://hub.cognite.com/open-industrial-data-211>scopes=["https://api.cognitedata.com/user_impersonation"]I would like to know if we can use the already defined Cognite tenant in AAD with Tenant Id “48d5043c-cf70-4c49-881c-c638f5796997” ? Are you providing the client id for that then? Similar to the ones publicly provided for Postman and JS-SDK? Please also note that I cannot use interactive login since it is not a one-off script.Moreover, I cannot re

13
Murad Sæter
Practitioner
8 months ago
A
Anonymous
published in Open Industrial Data

Hi, I'm Stig, your guide to Open Industrial Data

Hi All, I’m Stig Harald Gustavsen. For the past 15 years, I have been spending a third of my time on the Valhall oil platform. I work there as a metering technician/engineer. My daily tasks are production allocation, operating, calibrating, and maintaining the fiscal and analytical measurement systems.I’m incredibly passionate about Open Industrial Data (OID) and the concept of data sharing in general. I feel there is too little sharing of the data and information within heavy asset industrial sectors, mainly due to risk aversion. Humanity as a collective needs solutions on the industrial scale. When we withhold information, we hinder creativity and miss out on opportunities that we could leverage to create a better future together. A great example is how the internet has democratized information sharing in the commercial IT world. The more heavy asset-oriented industrial world has yet to go through this reformation. Still, I hope and wholeheartedly believe the OID is the start of this

3093
A
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Cognite Reveal

I work cognite reveal 3d images  in angular v12.1.1.  I using NPM  npm i @cognite/reveal@3.3.0 ,  @cognite/sdk@7.14.0 and  @cognite/potree-core@1.5.2,  Cognite reveal AxisViewTool is not working. error: (Module '"@cognite/reveal"' has no exported member 'AxisViewTool'.) 

31
K
Seasoned
7 months ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Cognite 3D Model

Learn Cognite 3d model, focus object, fit camera, search assets highlight object etc..

27
K
Seasoned
7 months ago
A
Anonymous
published in Open Industrial Data

Deep-dives into Open Industrial Data and how you can use it

Hi, Stig, your guide to Open Industrial Data (OID) here 👋In this article, I will introduce you to the reference data set of a industrial process system that the Open Industrial Data project contains. Analogous to what the Iris, Titanic, and gap-minder data sets are to learning data science tools, the OID project will be your entry ticket to working with industrial data. Here is a short technical description of the system on Valhall that is shared on the Open Industrial Data project. System descriptionThe data set represents the first of four stages of treatment of natural gas on the Valhall PH (Production Hotel) platform. The purpose of the gas train is to dry and compress the gas to meet the required export pressure and specification, with a total capacity of 4,06 [MSm3/d] (143 [MMscf/d]).The first stage compressor (23-KA-9101) is an electrically-driven, fixed-speed centrifugal compressor that receives gas from the separators at approximately 3 [barg] pressure. Before reaching the co

2040
A
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Interactive engineering diagrams

https://docs.cognite.com/cdf/integration/guides/contextualization/interactive_diagrams How to create engineering diagram, and How get label name in diagram “23-LAHH-96138” through JavaScript.

20
A
Seasoned Practitioner
1 month ago
I
Practitioner
Izabela HawrylkoPractitioner
published in Open Industrial Data

Who can use Open Industrial Data?

Hello Cognite Community! Izabela Hawrylko here, Cognite’s Partner Development Director working with our Application and Industry partners. In my day-to-day work, I’m joining forces with other digital disruptors to build “Partner+Cognite” technical and go-to-market strategies for end-to-end industry solutions solving most pressing industrial challenges.I can imagine you might be wondering who Open Industrial Data (OID) is for. Anyone who is an industrial data enthusiast. Curious mind interested in better understanding the industrial reality. Are you an Independent Software Vendor building solution and applications for heavy-asset industries? Market Incumbent looking for data to experiment and drive innovation for your products and services? Researcher? Student? We have created this project for you to explore real-life industrial data streams and experiment with analytics, building new algorithms and creating visualizations.Join hundreds of other industrial data enthusiasts and dive into

1410
I
Practitioner
1 year ago
Sverre Fjerdingstad
Seasoned Practitioner
Sverre FjerdingstadCognite Academy Instructor
posted in Open Industrial Data

Cognite Data Fusion for Domain Experts

This discussion is linked to the course Cognite Data Fusion for Domain Experts.A data-driven approach to maintenance is more efficient than relying on a fixed schedule or fixing something once it’s already broken. There are plenty of opportunities around us to take advantage of smart maintenance. Look around in your home, your office, or think of your work tasks. Where could data-driven maintenance make a difference?Share your thoughts! For example, explain what data you have available or would need in order to do smart maintenance, and how this would be an improvement of current methods. 

4
L
Committed
11 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Can the signals of warnings, alarms, and failures be used to tag anomalies and/or failures in the compressor?

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

9
Stig Harald Gustavsen
Seasoned
11 months ago
Madina Kholmatova
Seasoned Practitioner
Madina KholmatovaCognite Academy Instructor
posted in Open Industrial Data

Explore a Live Stream of Industrial Data with Power BI!

Do you know what courses are available for you to explore the data from the Open Industrial Data project?Cognite Academy creates e-learning courses with an emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data. In most of our courses, the training data we use comes from the Open Industrial Data (OID) project, a live stream of industrial data from the Valhall oil platform. While the data is from the oil and gas industry, it is relevant for all asset-heavy industries as it provides insights into dynamic industrial processes. In this article, I will share a series of CDF & Power BI courses where you can explore the Open Industrial Data and solve a simple use case in Power BI: Introduction to CDF & Power BI  In this course, you will connect Power BI to CDF, and retrieve the Open Industrial Data to learn how filtering and aggregation work with the connector in Power BI.  CDF & Power BI: Solving

1
Madina Kholmatova
Seasoned Practitioner
11 months ago
Stig Harald Gustavsen
Seasoned
Stig Harald GustavsenSeasoned
posted in Open Industrial Data

Get industrial data into Python from Open Industrial Data CDF project, thorugh OIDC auth

In this conversation I will explain / help how to access the data from the Open Industrial Data Project (OID) CDF Project, through the Cognite Python SDK, with authentication through an interactive login token from Cognite Hub’s Azure Active Directory. The video in the article will step by step show you how you can get access to the data, and also link to the relevant information you will need. Steps:1. Install or update the following python modules/librariespip install cognite-sdkpip install msalpip install pandas2. Download the publicdata.py file and store it in your python environments working directory. this file is prefilled with the OIDC ID’s and CDF project values needed to access the CDF project.3. Open a Jupyter Notebook or python file and import the publicdata.pyfrom publicdata import c4. Access the OID CDF project through the CogniteClient object: c, and when the first method is called on the CogniteClient object it will authenticate and redirect towards the AAD tenant and u

0
Stig Harald Gustavsen
Seasoned
10 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Where can I get the measurement units of the sensor data?

I'm working with the time series data for anomaly detections models and I would like to know the units of the sensor data. I found a master thesis based on the Open Industrial Data and for the variables selected for it; the author specifies the units:  But from the data I downloaded with the SDK the tag VAL_23_KA_9101_M01_62C:Z.X.Value     does not have unit:  I looked into the meta data field an the engunits key is empty:{'P&ID No': None, 'PLC': None, 'PLC tagname': None, 'Sensor type': None, 'Tag group': None, 'Tag type': None, '_replicatedInternalId': '4326942079596138', '_replicatedSource': 'akerbp', '_replicatedTime': '1593024714000', 'archiving': '1', 'compdev': '0', 'compdevpercent': '0', 'compmax': '28800', 'compmin': '0', 'compressing': '1', 'convers': '1', 'descriptor': 'PH 1stStg Comp Mtr Current', 'digitalset': '', 'displaydigits': '-5', 'engunits': '', 'excdev': '0', 'excdevpercent': '0', 'excmax': '600', 'excmin': '0', 'exdesc': '', 'external id': None, 'filtercode':

3
A
1 year ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

What is the recommended approach to using the work orders for identifying events of interest?

I have been looking into many work-orders looking for failures or anomalies, but at this point I’m not sure to take the most of the shared information, as example I’ll take the two following events: The work order 6516382362467974 has the following details available:  Description: Exterior leakage - liquid for the main process Shutdown: Revision (full shutdown) Planned Start: 2014-09-11 I also plotted some of the signals from near the planned start, as shown in the below image:  I have a few questions about the first work order:   It seems that the compressor turned off about two weeks before the planned start time (As the green dotted line shows)   is it safe to assume that is discrepancy is because the two-week delay in sharing the data?  Is there a set of signals that I can look into for this work-order, I’m assuming that since there is a leakage, the time series related to lube oil could be affected, or maybe the pressure of the compressor.   The second work order is 54865032

3
Stig Harald Gustavsen
Seasoned
10 months ago
jasar
Active
jasarActive
asked in Open Industrial Data

OID raw data

Hello,I am creating exercises for my team here at Globant, and I would like to know if it's possible to gain access to some raw data. This data would be used to train them in data extraction and normalization.Thank you for your assistance in this matter.

3
Sofie Haug
Practitioner
6 months ago
A
Active
AndyLActive
asked in Open Industrial Data

Can't list assets in postman using OIDC

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

3
D
Practitioner
9 months ago
A
Committed
Alex NarayananCommitted
asked in Open Industrial Data

Realtime use cases vs near realtime use cases

I’ve been introduced to CDF in the last 2 weeks, very interesting and learning through. Just wondering if CDF has been used for real time monitoring use cases, vs. predictive/BI type use cases. For example, how soon can the alerts be triggered from the time a new abnormal measurement is detected. I imagine that it depends on a lot of factors  such as network latency, source extractors, transform functions & schedules, Is there a threshold (say 1hr response time) beyond which CDF can be used.

2
A
Committed
6 months ago
T
Active
Tim HudsonActive
asked in Open Industrial Data

ArcGIS connector for CDF

We would like to have the ability to: Import directly from CDF to a geodatabase hosted in MS SQL Serverand/orHave the ability to view vector points, lines and polygons within ArcGIS Pro, ArcGIS Enterprise, and ArcGIS Online, with the ability to view and query the attribute tables, and modify symbology Have the ability to view such data in a web map either directly from a service or publish our own feature servicesA WFS may be suitable, but we would have to check with a sample service first.Can you help please?Thanks,Tim

4
gedi
Practitioner
7 months ago
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
posted in Open Industrial Data

Removing the option to use API keys for authentication in OID

OpenID Connect has been enabled on Open Industrial Data for three months.We will be removing the option to use API keys for authentication on November 1st, 2022.If you are still using API keys for authentication, please change the Authenticatioon to openID Connect. Learn how to do that in this article.

0
S
Practitioner
11 months ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn 360 Images

Learn 360 images in Cognite Reveal.

5
K
Seasoned
6 months ago
Alex
Practitioner
AlexPractitioner
asked in Open Industrial Data

Question about data in the Open Industrial Data

Hi @Stig Harald Gustavsen , I was wondering whether you could help me understand a bit more a couple of time series related to energy consumption for cooling and compression in the first stage compressor , and also if we can see/infer the Barrel of Oil Equivalent (BOE). for instance, I do not understand the diff between this time series: VAL_23-KA-9101-M01_active_power_kW  VAL_23-KA-9101-ASP VAL_23-KA-9101-ESP  Also, I see that Valhal is powered from shore via a 294 km long DC cable with 78MW capacity from Lista, but the compressor seems to “only” consume 9MW on average - what are the other large energy consumers on Valhal ?many thanks, Alex

3
Stig Harald Gustavsen
Seasoned
8 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Is it possible to download the CAD files?

Hi, is is the any way to download the CAD files of the Vulkan Control Room?  Or the CAD files of any of the assests? for example the heat exchanger?  

2
L
Committed
1 year ago
eberribeiro
Active
eberribeiroActive
asked in Open Industrial Data

OSDU and OID

Hi, I would like to understand the relationship of OSDU x OID? Are they competitors, the differ on, pros x cons.. Thanks in advance..

4
B
Active
5 months ago

Badge winners

  • Cognite Data Engineer Basics - T&C
    Nandini Thangalahas earned the badge Cognite Data Engineer Basics - T&C
  • Cognite Data Fusion Fundamentals
    Saad Alhamlanhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Domain Expert Basics
    Saad Alhamlanhas earned the badge Cognite Domain Expert Basics
  • Cognite Data Fusion Fundamentals
    patricknitschkehas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Scientist Basics
    mtnholthas earned the badge Cognite Data Scientist Basics
Show all badges
Terms & ConditionsCookie Settings