COGNITE HUB

Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 22 Topics
  • 97 Replies

22 Topics

R
Revathi.rameshActive Member
asked in Open Industrial Data

Request to load OID (sample data) into our project Cognite environment

We are looking for OID and/or subset of Bootcamp data to be loaded and available in our project Cognite environment for further exploration. Can you please create a support ticket for the same?

2
Stig Harald Gustavsen
3 days ago
K
Karthik KaliyaperumalActive Member
asked in Open Industrial Data

Learn Interactive engineering diagrams

https://docs.cognite.com/cdf/integration/guides/contextualization/interactive_diagrams How to create engineering diagram, and How get label name in diagram “23-LAHH-96138” through JavaScript.

15
C
3 days ago
K
Karthik KaliyaperumalActive Member
asked in Open Industrial Data

Learn Cognite Reveal

I work cognite reveal 3d images  in angular v12.1.1.  I using NPM  npm i @cognite/reveal@3.3.0 ,  @cognite/sdk@7.14.0 and  @cognite/potree-core@1.5.2,  Cognite reveal AxisViewTool is not working. error: (Module '"@cognite/reveal"' has no exported member 'AxisViewTool'.) 

23
K
17 days ago
A
arianActive Member
asked in Open Industrial Data

Client id for the Python-SDK

Hello,I have a Python project that uses publicdata project of Open Industrial Data. I am trying to refactor the authentication step to use Python-SDK with OAuth since the API keys are (being) deprecated.To do so, I need the parameters token_url, client_id, client_secret, scopes.I am setting the parameters as such:cognite_tenant_id = "48d5043c-cf70-4c49-881c-c638f5796997"token_url=f"https://login.microsoftonline.com/{cognite_tenant_id}/oauth2/v2.0/authorize"client_id=???client_secret=<client secret generated from Open Industrial Data https://hub.cognite.com/open-industrial-data-211>scopes=["https://api.cognitedata.com/user_impersonation"]I would like to know if we can use the already defined Cognite tenant in AAD with Tenant Id “48d5043c-cf70-4c49-881c-c638f5796997” ? Are you providing the client id for that then? Similar to the ones publicly provided for Postman and JS-SDK? Please also note that I cannot use interactive login since it is not a one-off script.Moreover, I cannot re

13
Murad Sæter
18 days ago
Alex
AlexActive Member
asked in Open Industrial Data

Question about data in the Open Industrial Data

Hi @Stig Harald Gustavsen , I was wondering whether you could help me understand a bit more a couple of time series related to energy consumption for cooling and compression in the first stage compressor , and also if we can see/infer the Barrel of Oil Equivalent (BOE). for instance, I do not understand the diff between this time series: VAL_23-KA-9101-M01_active_power_kW  VAL_23-KA-9101-ASP VAL_23-KA-9101-ESP  Also, I see that Valhal is powered from shore via a 294 km long DC cable with 78MW capacity from Lista, but the compressor seems to “only” consume 9MW on average - what are the other large energy consumers on Valhal ?many thanks, Alex

3
Stig Harald Gustavsen
24 days ago
A
AndyLActive Member
asked in Open Industrial Data

Can't list assets in postman using OIDC

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

3
D
1 month ago
S
Shehan KarunaratnePrincipal Support Engineer
published in Open Industrial Data

OpenID Connect on Open Industrial Data

OpenID Connect is now available on Open Industrial Data (OID). When you sign up to Cognite Hub, you get an account for the Open Industrial Data project.Whether you are new to OID or have been using API keys to access the data in this project, here’s all you need to get started with OIDC.Details to create the Cognite client when using Postman and Python SDK Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - 1b90ede3-271e-401b-81a0-a4d52bea3273, project=publicdata, CDF_CLUSTER - api App name: OID-Api Note: This app registration is configured with replyURLs for Postman and to run locally in http/https.  This app registration is configured with localhost to run python SDK apps locally with http/htpps. Details to create the cognite client when using JavaScript applications Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - dea6bb8d-0f48-4bf0-a469-176fc19edc14, project=publicdata, CDF_CLUSTER - api App name: OID-js Note: This app registration is configur

8596
Madina Kholmatova
2 months ago
L
Luis Ramon Ramirez RodriguezActive Member
asked in Open Industrial Data

What is the recommended approach to using the work orders for identifying events of interest?

I have been looking into many work-orders looking for failures or anomalies, but at this point I’m not sure to take the most of the shared information, as example I’ll take the two following events: The work order 6516382362467974 has the following details available:  Description: Exterior leakage - liquid for the main process Shutdown: Revision (full shutdown) Planned Start: 2014-09-11 I also plotted some of the signals from near the planned start, as shown in the below image:  I have a few questions about the first work order:   It seems that the compressor turned off about two weeks before the planned start time (As the green dotted line shows)   is it safe to assume that is discrepancy is because the two-week delay in sharing the data?  Is there a set of signals that I can look into for this work-order, I’m assuming that since there is a leakage, the time series related to lube oil could be affected, or maybe the pressure of the compressor.   The second work order is 54865032

3
Stig Harald Gustavsen
2 months ago
majofoal
majofoal
posted in Open Industrial Data

How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

4
Madina Kholmatova
2 months ago
Stig Harald Gustavsen
Stig Harald GustavsenExperienced Member
posted in Open Industrial Data

Get industrial data into Python from Open Industrial Data CDF project, thorugh OIDC auth

In this conversation I will explain / help how to access the data from the Open Industrial Data Project (OID) CDF Project, through the Cognite Python SDK, with authentication through an interactive login token from Cognite Hub’s Azure Active Directory. The video in the article will step by step show you how you can get access to the data, and also link to the relevant information you will need. Steps:1. Install or update the following python modules/librariespip install cognite-sdkpip install msalpip install pandas2. Download the publicdata.py file and store it in your python environments working directory. this file is prefilled with the OIDC ID’s and CDF project values needed to access the CDF project.3. Open a Jupyter Notebook or python file and import the publicdata.pyfrom publicdata import c4. Access the OID CDF project through the CogniteClient object: c, and when the first method is called on the CogniteClient object it will authenticate and redirect towards the AAD tenant and u

0
Stig Harald Gustavsen
2 months ago
S
Shehan KarunaratnePrincipal Support Engineer
posted in Open Industrial Data

Removing the option to use API keys for authentication in OID

OpenID Connect has been enabled on Open Industrial Data for three months.We will be removing the option to use API keys for authentication on November 1st, 2022.If you are still using API keys for authentication, please change the Authenticatioon to openID Connect. Learn how to do that in this article.

0
S
3 months ago
L
Luis Ramon Ramirez RodriguezActive Member
asked in Open Industrial Data

Can the signals of warnings, alarms, and failures be used to tag anomalies and/or failures in the compressor?

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

9
Stig Harald Gustavsen
3 months ago
L
Luis Ramon Ramirez RodriguezActive Member
asked in Open Industrial Data

Did the sampling frequency changed over the years?

I'm working on identifying the falling and rising edges of the VAL_23-KA-9101-M01:HSI.StatusMotorOn signal. For that and shifting the TS and rest the values, if I get -1 is a falling edge and for 1 it is a rising edge.  For the first row it works fine:  But I’m also getting a lot of values different than 1 or -1. Especially for more recent years. I guess that the problem is at the aggregating step, since I downloaded the data at a 1m frequency I get not int values for some records. Now, I was trying to download this TS at a 1s frequency, but I get a different number of records depending on the year.  E.G. for 2014 I get 34 records for a 10 days time windows with a granularity 1m.  If I do the same but for 2020 I get 1411, much more than for 2014, but still a tenth of the expected count.  If I change the granularity to 1s, I still get the same number of records, but with more precision in the time stamp:   Considering this, is there a recommended granularity to download the data and min

2
G
3 months ago
Sverre Fjerdingstad
Sverre FjerdingstadCognite Academy Instructor
posted in Open Industrial Data

Cognite Data Fusion for Domain Experts

This discussion is linked to the course Cognite Data Fusion for Domain Experts.A data-driven approach to maintenance is more efficient than relying on a fixed schedule or fixing something once it’s already broken. There are plenty of opportunities around us to take advantage of smart maintenance. Look around in your home, your office, or think of your work tasks. Where could data-driven maintenance make a difference?Share your thoughts! For example, explain what data you have available or would need in order to do smart maintenance, and how this would be an improvement of current methods. 

4
L
3 months ago
Madina Kholmatova
Madina KholmatovaCognite Academy Instructor
posted in Open Industrial Data

Explore a Live Stream of Industrial Data with Power BI!

Do you know what courses are available for you to explore the data from the Open Industrial Data project?Cognite Academy creates e-learning courses with an emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data. In most of our courses, the training data we use comes from the Open Industrial Data (OID) project, a live stream of industrial data from the Valhall oil platform. While the data is from the oil and gas industry, it is relevant for all asset-heavy industries as it provides insights into dynamic industrial processes. In this article, I will share a series of CDF & Power BI courses where you can explore the Open Industrial Data and solve a simple use case in Power BI: Introduction to CDF & Power BI  In this course, you will connect Power BI to CDF, and retrieve the Open Industrial Data to learn how filtering and aggregation work with the connector in Power BI.  CDF & Power BI: Solving

1
Madina Kholmatova
3 months ago
L
Luis Ramon Ramirez RodriguezActive Member
asked in Open Industrial Data

Where can I get the measurement units of the sensor data?

I'm working with the time series data for anomaly detections models and I would like to know the units of the sensor data. I found a master thesis based on the Open Industrial Data and for the variables selected for it; the author specifies the units:  But from the data I downloaded with the SDK the tag VAL_23_KA_9101_M01_62C:Z.X.Value     does not have unit:  I looked into the meta data field an the engunits key is empty:{'P&ID No': None, 'PLC': None, 'PLC tagname': None, 'Sensor type': None, 'Tag group': None, 'Tag type': None, '_replicatedInternalId': '4326942079596138', '_replicatedSource': 'akerbp', '_replicatedTime': '1593024714000', 'archiving': '1', 'compdev': '0', 'compdevpercent': '0', 'compmax': '28800', 'compmin': '0', 'compressing': '1', 'convers': '1', 'descriptor': 'PH 1stStg Comp Mtr Current', 'digitalset': '', 'displaydigits': '-5', 'engunits': '', 'excdev': '0', 'excdevpercent': '0', 'excmax': '600', 'excmin': '0', 'exdesc': '', 'external id': None, 'filtercode':

3
A
4 months ago
S
Stefaans ErasmusNew Member
asked in Open Industrial Data

Power Quality/Frequency Measurement

Hi All. I am in search of a meter that measures either the power quality of the power supplied to the Valhall platform or a measurement of the power frequency (Hz) at the Valhall Platform. TO me, it does not look like such data exists here on the OID. Am I correct?

1
A
4 months ago
L
Luis Ramon Ramirez RodriguezActive Member
asked in Open Industrial Data

Is it possible to download the CAD files?

Hi, is is the any way to download the CAD files of the Vulkan Control Room?  Or the CAD files of any of the assests? for example the heat exchanger?  

2
L
4 months ago
A
Anonymous
published in Open Industrial Data

Hi, I'm Stig, your guide to Open Industrial Data

Hi All, I’m Stig Harald Gustavsen. For the past 15 years, I have been spending a third of my time on the Valhall oil platform. I work there as a metering technician/engineer. My daily tasks are production allocation, operating, calibrating, and maintaining the fiscal and analytical measurement systems.I’m incredibly passionate about Open Industrial Data (OID) and the concept of data sharing in general. I feel there is too little sharing of the data and information within heavy asset industrial sectors, mainly due to risk aversion. Humanity as a collective needs solutions on the industrial scale. When we withhold information, we hinder creativity and miss out on opportunities that we could leverage to create a better future together. A great example is how the internet has democratized information sharing in the commercial IT world. The more heavy asset-oriented industrial world has yet to go through this reformation. Still, I hope and wholeheartedly believe the OID is the start of this

2353
A
5 months ago
Eniko Farkas
Eniko FarkasCognite Academy Instructor
published in Open Industrial Data

What is Open Industrial Data?featured

Hi, I’m Enikö Farkas from Cognite. With my team, we create e-learning for Cognite Learn. In our courses, we put a lot of emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data.In most of our courses, the training data we use comes from the Open Industrial Data (OID) project which is the result of a collaboration between Aker BP, one of Europe’s largest independent oil companies, and Cognite. While the data is from the oil and gas industry, its relevance is much broader: it gives us insight into dynamic industrial processes and can inspire all industries.In this article, I’m excited to share more about this project.About the dataThe data originates from a single compressor on Aker BP’s Valhall oil platform in the North Sea. Aker BP selected the first stage compressor on the Valhall because it is a subsystem with clearly defined boundaries, rich in time series and maintenance data.AkerBP uses Cognite Data Fusio

4590
Eniko Farkas
6 months ago
I
Izabela HawrylkoNew Member
published in Open Industrial Data

Who can use Open Industrial Data?

Hello Cognite Community! Izabela Hawrylko here, Cognite’s Partner Development Director working with our Application and Industry partners. In my day-to-day work, I’m joining forces with other digital disruptors to build “Partner+Cognite” technical and go-to-market strategies for end-to-end industry solutions solving most pressing industrial challenges.I can imagine you might be wondering who Open Industrial Data (OID) is for. Anyone who is an industrial data enthusiast. Curious mind interested in better understanding the industrial reality. Are you an Independent Software Vendor building solution and applications for heavy-asset industries? Market Incumbent looking for data to experiment and drive innovation for your products and services? Researcher? Student? We have created this project for you to explore real-life industrial data streams and experiment with analytics, building new algorithms and creating visualizations.Join hundreds of other industrial data enthusiasts and dive into

980
I
6 months ago
A
Anonymous
published in Open Industrial Data

Deep-dives into Open Industrial Data and how you can use it

Hi, Stig, your guide to Open Industrial Data (OID) here 👋In this article, I will introduce you to the reference data set of a industrial process system that the Open Industrial Data project contains. Analogous to what the Iris, Titanic, and gap-minder data sets are to learning data science tools, the OID project will be your entry ticket to working with industrial data. Here is a short technical description of the system on Valhall that is shared on the Open Industrial Data project. System descriptionThe data set represents the first of four stages of treatment of natural gas on the Valhall PH (Production Hotel) platform. The purpose of the gas train is to dry and compress the gas to meet the required export pressure and specification, with a total capacity of 4,06 [MSm3/d] (143 [MMscf/d]).The first stage compressor (23-KA-9101) is an electrically-driven, fixed-speed centrifugal compressor that receives gas from the separators at approximately 3 [barg] pressure. Before reaching the co

1250
A
6 months ago

Generate client secret for OID

Please generate a client secret once every 180 days.




Badge winners

Show all badges
Terms & ConditionsCookie settings