Skip to main content

Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 47 Topics
  • 217 Replies
47 Topics
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
published in Open Industrial Data
OpenID Connect on Open Industrial Data

OpenID Connect is now available on Open Industrial Data (OID). When you sign up to Cognite Hub, you get an account for the Open Industrial Data project.Whether you are new to OID or have been using API keys to access the data in this project, here’s all you need to get started with OIDC.Details to create the Cognite client when using Postman and Python SDK Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - 1b90ede3-271e-401b-81a0-a4d52bea3273, project=publicdata, CDF_CLUSTER - api App name: OID-Api Note: This app registration is configured with replyURLs for Postman and to run locally in http/https.  This app registration is configured with localhost to run python SDK apps locally with http/htpps. Details to create the cognite client when using JavaScript applications Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - dea6bb8d-0f48-4bf0-a469-176fc19edc14, project=publicdata, CDF_CLUSTER - api App name: OID-js Note: This app registration is configur

23307
A
Active
10 months ago
E
Seasoned Practitioner
Eniko FarkasCognite Academy Instructor
published in Open Industrial Data
What is Open Industrial Data?featured

Hi, I’m Enikö Farkas from Cognite. With my team, we create e-learning for Cognite Academy. In our courses, we put a lot of emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data.In most of our courses, the training data we use comes from the Open Industrial Data (OID) project which is the result of a collaboration between Aker BP, one of Europe’s largest independent oil companies, and Cognite. While the data is from the oil and gas industry, its relevance is much broader: it gives us insight into dynamic industrial processes and can inspire all industries.In this article, I’m excited to share more about this project.About the dataThe data originates from a single compressor on Aker BP’s Valhall oil platform in the North Sea. Aker BP selected the first stage compressor on the Valhall because it is a subsystem with clearly defined boundaries, rich in time series and maintenance data.AkerBP uses Cognite Data Fus

21642
E
Seasoned Practitioner
10 months ago
Maria Fonseca
Practitioner
Maria FonsecaPractitioner
posted in Open Industrial Data
How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

6
E
Seasoned Practitioner
1 year ago
A
Committed
arianCommitted
asked in Open Industrial Data
Client id for the Python-SDK

Hello,I have a Python project that uses publicdata project of Open Industrial Data. I am trying to refactor the authentication step to use Python-SDK with OAuth since the API keys are (being) deprecated.To do so, I need the parameters token_url, client_id, client_secret, scopes.I am setting the parameters as such:cognite_tenant_id = "48d5043c-cf70-4c49-881c-c638f5796997"token_url=f"https://login.microsoftonline.com/{cognite_tenant_id}/oauth2/v2.0/authorize"client_id=???client_secret=<client secret generated from Open Industrial Data https://hub.cognite.com/open-industrial-data-211>scopes=["https://api.cognitedata.com/user_impersonation"]I would like to know if we can use the already defined Cognite tenant in AAD with Tenant Id “48d5043c-cf70-4c49-881c-c638f5796997” ? Are you providing the client id for that then? Similar to the ones publicly provided for Postman and JS-SDK? Please also note that I cannot use interactive login since it is not a one-off script.Moreover, I cannot re

13
Murad Sæter
Practitioner
1 year ago
A
Anonymous
published in Open Industrial Data
Hi, I'm Stig, your guide to Open Industrial Data

Hi All, I’m Stig Harald Gustavsen. For the past 15 years, I have been spending a third of my time on the Valhall oil platform. I work there as a metering technician/engineer. My daily tasks are production allocation, operating, calibrating, and maintaining the fiscal and analytical measurement systems.I’m incredibly passionate about Open Industrial Data (OID) and the concept of data sharing in general. I feel there is too little sharing of the data and information within heavy asset industrial sectors, mainly due to risk aversion. Humanity as a collective needs solutions on the industrial scale. When we withhold information, we hinder creativity and miss out on opportunities that we could leverage to create a better future together. A great example is how the internet has democratized information sharing in the commercial IT world. The more heavy asset-oriented industrial world has yet to go through this reformation. Still, I hope and wholeheartedly believe the OID is the start of this

3933
A
2 years ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Cognite Reveal

I work cognite reveal 3d images  in angular v12.1.1.  I using NPM  npm i @cognite/reveal@3.3.0 ,  @cognite/sdk@7.14.0 and  @cognite/potree-core@1.5.2,  Cognite reveal AxisViewTool is not working. error: (Module '"@cognite/reveal"' has no exported member 'AxisViewTool'.) 

31
K
Seasoned
1 year ago
Sverre Fjerdingstad
Practitioner
Sverre FjerdingstadCognite Academy Instructor
posted in Open Industrial Data
Cognite Data Fusion for Domain Experts

This discussion is linked to the course Cognite Data Fusion for Domain Experts.A data-driven approach to maintenance is more efficient than relying on a fixed schedule or fixing something once it’s already broken. There are plenty of opportunities around us to take advantage of smart maintenance. Look around in your home, your office, or think of your work tasks. Where could data-driven maintenance make a difference?Share your thoughts! For example, explain what data you have available or would need in order to do smart maintenance, and how this would be an improvement of current methods. 

10
B
Active
18 days ago
A
Anonymous
published in Open Industrial Data
Deep-dives into Open Industrial Data and how you can use it

Hi, Stig, your guide to Open Industrial Data (OID) here 👋In this article, I will introduce you to the reference data set of a industrial process system that the Open Industrial Data project contains. Analogous to what the Iris, Titanic, and gap-minder data sets are to learning data science tools, the OID project will be your entry ticket to working with industrial data. Here is a short technical description of the system on Valhall that is shared on the Open Industrial Data project. System descriptionThe data set represents the first of four stages of treatment of natural gas on the Valhall PH (Production Hotel) platform. The purpose of the gas train is to dry and compress the gas to meet the required export pressure and specification, with a total capacity of 4,06 [MSm3/d] (143 [MMscf/d]).The first stage compressor (23-KA-9101) is an electrically-driven, fixed-speed centrifugal compressor that receives gas from the separators at approximately 3 [barg] pressure. Before reaching the co

2850
A
2 years ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Cognite 3D Model

Learn Cognite 3d model, focus object, fit camera, search assets highlight object etc..

27
K
Seasoned
1 year ago
I
Practitioner
Izabela HawrylkoPractitioner
published in Open Industrial Data
Who can use Open Industrial Data?

Hello Cognite Community! Izabela Hawrylko here, Cognite’s Partner Development Director working with our Application and Industry partners. In my day-to-day work, I’m joining forces with other digital disruptors to build “Partner+Cognite” technical and go-to-market strategies for end-to-end industry solutions solving most pressing industrial challenges.I can imagine you might be wondering who Open Industrial Data (OID) is for. Anyone who is an industrial data enthusiast. Curious mind interested in better understanding the industrial reality. Are you an Independent Software Vendor building solution and applications for heavy-asset industries? Market Incumbent looking for data to experiment and drive innovation for your products and services? Researcher? Student? We have created this project for you to explore real-life industrial data streams and experiment with analytics, building new algorithms and creating visualizations.Join hundreds of other industrial data enthusiasts and dive into

2270
I
Practitioner
2 years ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Interactive engineering diagrams

https://docs.cognite.com/cdf/integration/guides/contextualization/interactive_diagrams How to create engineering diagram, and How get label name in diagram “23-LAHH-96138” through JavaScript.

20
A
Seasoned Practitioner
1 year ago
Madina Kholmatova
Seasoned Practitioner
Madina KholmatovaCognite Academy Instructor
posted in Open Industrial Data
Explore a Live Stream of Industrial Data with Power BI!

Do you know what courses are available for you to explore the data from the Open Industrial Data project?Cognite Academy creates e-learning courses with an emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data. In most of our courses, the training data we use comes from the Open Industrial Data (OID) project, a live stream of industrial data from the Valhall oil platform. While the data is from the oil and gas industry, it is relevant for all asset-heavy industries as it provides insights into dynamic industrial processes. In this article, I will share a series of CDF & Power BI courses where you can explore the Open Industrial Data and solve a simple use case in Power BI: Introduction to CDF & Power BI  In this course, you will connect Power BI to CDF, and retrieve the Open Industrial Data to learn how filtering and aggregation work with the connector in Power BI.  CDF & Power BI: Solving

1
Madina Kholmatova
Seasoned Practitioner
1 year ago
T
Committed
Tim HudsonCommitted
asked in Open Industrial Data
ArcGIS connector for CDF

We would like to have the ability to: Import directly from CDF to a geodatabase hosted in MS SQL Serverand/orHave the ability to view vector points, lines and polygons within ArcGIS Pro, ArcGIS Enterprise, and ArcGIS Online, with the ability to view and query the attribute tables, and modify symbology Have the ability to view such data in a web map either directly from a service or publish our own feature servicesA WFS may be suitable, but we would have to check with a sample service first.Can you help please?Thanks,Tim

6
T
Committed
5 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Can the signals of warnings, alarms, and failures be used to tag anomalies and/or failures in the compressor?

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

9
Stig Harald Gustavsen
Seasoned
1 year ago
Stig Harald Gustavsen
Seasoned
Stig Harald GustavsenSeasoned
posted in Open Industrial Data
Get industrial data into Python from Open Industrial Data CDF project, thorugh OIDC auth

In this conversation I will explain / help how to access the data from the Open Industrial Data Project (OID) CDF Project, through the Cognite Python SDK, with authentication through an interactive login token from Cognite Hub’s Azure Active Directory. The video in the article will step by step show you how you can get access to the data, and also link to the relevant information you will need. Steps:1. Install or update the following python modules/librariespip install cognite-sdkpip install msalpip install pandas2. Download the publicdata.py file and store it in your python environments working directory. this file is prefilled with the OIDC ID’s and CDF project values needed to access the CDF project.3. Open a Jupyter Notebook or python file and import the publicdata.pyfrom publicdata import c4. Access the OID CDF project through the CogniteClient object: c, and when the first method is called on the CogniteClient object it will authenticate and redirect towards the AAD tenant and u

0
Stig Harald Gustavsen
Seasoned
1 year ago
R
Seasoned
Raluca BalaSeasoned
asked in Open Industrial Data
Aker BP

Hello! Is there a repository where the Aker BP open data is available for direct download? ( asset hierarchy, work orders, P&ID file)? 

2
R
Seasoned
10 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Where can I get the measurement units of the sensor data?

I'm working with the time series data for anomaly detections models and I would like to know the units of the sensor data. I found a master thesis based on the Open Industrial Data and for the variables selected for it; the author specifies the units:  But from the data I downloaded with the SDK the tag VAL_23_KA_9101_M01_62C:Z.X.Value     does not have unit:  I looked into the meta data field an the engunits key is empty:{'P&ID No': None, 'PLC': None, 'PLC tagname': None, 'Sensor type': None, 'Tag group': None, 'Tag type': None, '_replicatedInternalId': '4326942079596138', '_replicatedSource': 'akerbp', '_replicatedTime': '1593024714000', 'archiving': '1', 'compdev': '0', 'compdevpercent': '0', 'compmax': '28800', 'compmin': '0', 'compressing': '1', 'convers': '1', 'descriptor': 'PH 1stStg Comp Mtr Current', 'digitalset': '', 'displaydigits': '-5', 'engunits': '', 'excdev': '0', 'excdevpercent': '0', 'excmax': '600', 'excmin': '0', 'exdesc': '', 'external id': None, 'filtercode':

3
A
2 years ago
A
Active
AndyLActive
asked in Open Industrial Data
Can't list assets in postman using OIDC

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

4
Elcio Cardoso da Silva
Committed
16 days ago
jasar
Active
jasarActive
asked in Open Industrial Data
OID raw data

Hello,I am creating exercises for my team here at Globant, and I would like to know if it's possible to gain access to some raw data. This data would be used to train them in data extraction and normalization.Thank you for your assistance in this matter.

3
Sofie Haug
Practitioner
1 year ago
Andre Alves
MVP
Andre AlvesMVP
asked in Open Industrial Data
Extracting asset data from engineering data sources like PI&D documents

We are delving into the specifics of using Cognite for certain use cases and have identified the necessity for automatically extracting asset data from engineering data sources like PI&D documents. Are there any features available to facilitate this?For instance, our clients possess numerous PI&D documents and require automatic generation and structuring of asset hierarchies.

3
Andre Alves
MVP
9 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
What is the recommended approach to using the work orders for identifying events of interest?

I have been looking into many work-orders looking for failures or anomalies, but at this point I’m not sure to take the most of the shared information, as example I’ll take the two following events: The work order 6516382362467974 has the following details available:  Description: Exterior leakage - liquid for the main process Shutdown: Revision (full shutdown) Planned Start: 2014-09-11 I also plotted some of the signals from near the planned start, as shown in the below image:  I have a few questions about the first work order:   It seems that the compressor turned off about two weeks before the planned start time (As the green dotted line shows)   is it safe to assume that is discrepancy is because the two-week delay in sharing the data?  Is there a set of signals that I can look into for this work-order, I’m assuming that since there is a leakage, the time series related to lube oil could be affected, or maybe the pressure of the compressor.   The second work order is 54865032

3
Stig Harald Gustavsen
Seasoned
1 year ago
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
posted in Open Industrial Data
Removing the option to use API keys for authentication in OID

OpenID Connect has been enabled on Open Industrial Data for three months.We will be removing the option to use API keys for authentication on November 1st, 2022.If you are still using API keys for authentication, please change the Authenticatioon to openID Connect. Learn how to do that in this article.

0
S
Practitioner
1 year ago
A
Committed
Alex NarayananCommitted
asked in Open Industrial Data
Realtime use cases vs near realtime use cases

I’ve been introduced to CDF in the last 2 weeks, very interesting and learning through. Just wondering if CDF has been used for real time monitoring use cases, vs. predictive/BI type use cases. For example, how soon can the alerts be triggered from the time a new abnormal measurement is detected. I imagine that it depends on a lot of factors  such as network latency, source extractors, transform functions & schedules, Is there a threshold (say 1hr response time) beyond which CDF can be used.

2
A
Committed
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn 360 Images

Learn 360 images in Cognite Reveal.

5
K
Seasoned
1 year ago
R
Active
RAMOJIActive
asked in Open Industrial Data
How to configure CDF as datasource to grafana

Hi team, I am trying to connect CDF as data source to Grafana but i am unable to do that i am  getting Authentication to data source failed error.I am using same oauth credentials which were i used before in python sdk to extract assets and time series data but in this case  those credentials are not working . My doubt is am I need to register new application in microsoft azure entra id or not?????

3
Dilini Fernando
Seasoned Practitioner
6 months ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings