Skip to main content

Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 48 Topics
  • 220 Replies
48 Topics
Maria Fonseca
Practitioner
Maria FonsecaPractitioner
posted in Open Industrial Data
How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

8986
E
Seasoned Practitioner
1 year ago
eberribeiro
Active
eberribeiroActive
asked in Open Industrial Data
OSDU and OID

Hi, I would like to understand the relationship of OSDU x OID? Are they competitors, the differ on, pros x cons.. Thanks in advance..

884
B
1 year ago
jasar
Active
jasarActive
asked in Open Industrial Data
OID raw data

Hello,I am creating exercises for my team here at Globant, and I would like to know if it's possible to gain access to some raw data. This data would be used to train them in data extraction and normalization.Thank you for your assistance in this matter.

1223
Sofie Haug
Practitioner
1 year ago
A
Committed
Alex NarayananCommitted
asked in Open Industrial Data
Realtime use cases vs near realtime use cases

I’ve been introduced to CDF in the last 2 weeks, very interesting and learning through. Just wondering if CDF has been used for real time monitoring use cases, vs. predictive/BI type use cases. For example, how soon can the alerts be triggered from the time a new abnormal measurement is detected. I imagine that it depends on a lot of factors  such as network latency, source extractors, transform functions & schedules, Is there a threshold (say 1hr response time) beyond which CDF can be used.

982
A
Committed
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn 360 Images

Learn 360 images in Cognite Reveal.

975
K
Seasoned
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Cognite 3D Model

Learn Cognite 3d model, focus object, fit camera, search assets highlight object etc..

27427
K
Seasoned
1 year ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreHead of Academy and Community
published in Open Industrial Data
What are level badges?

Hi Community Members! As we grow we're constantly looking to improve our community, and one of the changes you might notice is the new level badges. You can read more about level badges here. We hope you like it, you’ve earned it!    

310
Anita Hæhre
Seasoned Practitioner
1 year ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Cognite Reveal

I work cognite reveal 3d images  in angular v12.1.1.  I using NPM  npm i @cognite/reveal@3.3.0 ,  @cognite/sdk@7.14.0 and  @cognite/potree-core@1.5.2,  Cognite reveal AxisViewTool is not working. error: (Module '"@cognite/reveal"' has no exported member 'AxisViewTool'.) 

38631
K
Seasoned
1 year ago
R
Active
Revathi.rameshActive
asked in Open Industrial Data
Request to load OID (sample data) into our project Cognite environment

We are looking for OID and/or subset of Bootcamp data to be loaded and available in our project Cognite environment for further exploration. Can you please create a support ticket for the same?

492
Stig Harald Gustavsen
Seasoned
1 year ago
A
Committed
arianCommitted
asked in Open Industrial Data
Client id for the Python-SDK

Hello,I have a Python project that uses publicdata project of Open Industrial Data. I am trying to refactor the authentication step to use Python-SDK with OAuth since the API keys are (being) deprecated.To do so, I need the parameters token_url, client_id, client_secret, scopes.I am setting the parameters as such:cognite_tenant_id = "48d5043c-cf70-4c49-881c-c638f5796997"token_url=f"https://login.microsoftonline.com/{cognite_tenant_id}/oauth2/v2.0/authorize"client_id=???client_secret=<client secret generated from Open Industrial Data https://hub.cognite.com/open-industrial-data-211>scopes=["https://api.cognitedata.com/user_impersonation"]I would like to know if we can use the already defined Cognite tenant in AAD with Tenant Id “48d5043c-cf70-4c49-881c-c638f5796997” ? Are you providing the client id for that then? Similar to the ones publicly provided for Postman and JS-SDK? Please also note that I cannot use interactive login since it is not a one-off script.Moreover, I cannot re

52313
Murad Sæter
Practitioner
1 year ago
Alex
Practitioner
AlexPractitioner
asked in Open Industrial Data
Question about data in the Open Industrial Data

Hi @Stig Harald Gustavsen , I was wondering whether you could help me understand a bit more a couple of time series related to energy consumption for cooling and compression in the first stage compressor , and also if we can see/infer the Barrel of Oil Equivalent (BOE). for instance, I do not understand the diff between this time series: VAL_23-KA-9101-M01_active_power_kW  VAL_23-KA-9101-ASP VAL_23-KA-9101-ESP  Also, I see that Valhal is powered from shore via a 294 km long DC cable with 78MW capacity from Lista, but the compressor seems to “only” consume 9MW on average - what are the other large energy consumers on Valhal ?many thanks, Alex

943
Stig Harald Gustavsen
Seasoned
1 year ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
What is the recommended approach to using the work orders for identifying events of interest?

I have been looking into many work-orders looking for failures or anomalies, but at this point I’m not sure to take the most of the shared information, as example I’ll take the two following events: The work order 6516382362467974 has the following details available:  Description: Exterior leakage - liquid for the main process Shutdown: Revision (full shutdown) Planned Start: 2014-09-11 I also plotted some of the signals from near the planned start, as shown in the below image:  I have a few questions about the first work order:   It seems that the compressor turned off about two weeks before the planned start time (As the green dotted line shows)   is it safe to assume that is discrepancy is because the two-week delay in sharing the data?  Is there a set of signals that I can look into for this work-order, I’m assuming that since there is a leakage, the time series related to lube oil could be affected, or maybe the pressure of the compressor.   The second work order is 54865032

1053
Stig Harald Gustavsen
Seasoned
1 year ago
Stig Harald Gustavsen
Seasoned
Stig Harald GustavsenSeasoned
posted in Open Industrial Data
Get industrial data into Python from Open Industrial Data CDF project, thorugh OIDC auth

In this conversation I will explain / help how to access the data from the Open Industrial Data Project (OID) CDF Project, through the Cognite Python SDK, with authentication through an interactive login token from Cognite Hub’s Azure Active Directory. The video in the article will step by step show you how you can get access to the data, and also link to the relevant information you will need. Steps:1. Install or update the following python modules/librariespip install cognite-sdkpip install msalpip install pandas2. Download the publicdata.py file and store it in your python environments working directory. this file is prefilled with the OIDC ID’s and CDF project values needed to access the CDF project.3. Open a Jupyter Notebook or python file and import the publicdata.pyfrom publicdata import c4. Access the OID CDF project through the CogniteClient object: c, and when the first method is called on the CogniteClient object it will authenticate and redirect towards the AAD tenant and u

1490
Stig Harald Gustavsen
Seasoned
1 year ago
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
posted in Open Industrial Data
Removing the option to use API keys for authentication in OID

OpenID Connect has been enabled on Open Industrial Data for three months.We will be removing the option to use API keys for authentication on November 1st, 2022.If you are still using API keys for authentication, please change the Authenticatioon to openID Connect. Learn how to do that in this article.

1030
S
Practitioner
2 years ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Can the signals of warnings, alarms, and failures be used to tag anomalies and/or failures in the compressor?

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

1639
Stig Harald Gustavsen
Seasoned
2 years ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Did the sampling frequency changed over the years?

I'm working on identifying the falling and rising edges of the VAL_23-KA-9101-M01:HSI.StatusMotorOn signal. For that and shifting the TS and rest the values, if I get -1 is a falling edge and for 1 it is a rising edge.  For the first row it works fine:  But I’m also getting a lot of values different than 1 or -1. Especially for more recent years. I guess that the problem is at the aggregating step, since I downloaded the data at a 1m frequency I get not int values for some records. Now, I was trying to download this TS at a 1s frequency, but I get a different number of records depending on the year.  E.G. for 2014 I get 34 records for a 10 days time windows with a granularity 1m.  If I do the same but for 2020 I get 1411, much more than for 2014, but still a tenth of the expected count.  If I change the granularity to 1s, I still get the same number of records, but with more precision in the time stamp:   Considering this, is there a recommended granularity to download the data and min

562
G
Seasoned Practitioner
2 years ago
Madina Kholmatova
Seasoned Practitioner
Madina KholmatovaCognite Academy Instructor
posted in Open Industrial Data
Explore a Live Stream of Industrial Data with Power BI!

Do you know what courses are available for you to explore the data from the Open Industrial Data project?Cognite Academy creates e-learning courses with an emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data. In most of our courses, the training data we use comes from the Open Industrial Data (OID) project, a live stream of industrial data from the Valhall oil platform. While the data is from the oil and gas industry, it is relevant for all asset-heavy industries as it provides insights into dynamic industrial processes. In this article, I will share a series of CDF & Power BI courses where you can explore the Open Industrial Data and solve a simple use case in Power BI: Introduction to CDF & Power BI  In this course, you will connect Power BI to CDF, and retrieve the Open Industrial Data to learn how filtering and aggregation work with the connector in Power BI.  CDF & Power BI: Solving

1811
Madina Kholmatova
Seasoned Practitioner
2 years ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Where can I get the measurement units of the sensor data?

I'm working with the time series data for anomaly detections models and I would like to know the units of the sensor data. I found a master thesis based on the Open Industrial Data and for the variables selected for it; the author specifies the units:  But from the data I downloaded with the SDK the tag VAL_23_KA_9101_M01_62C:Z.X.Value     does not have unit:  I looked into the meta data field an the engunits key is empty:{'P&ID No': None, 'PLC': None, 'PLC tagname': None, 'Sensor type': None, 'Tag group': None, 'Tag type': None, '_replicatedInternalId': '4326942079596138', '_replicatedSource': 'akerbp', '_replicatedTime': '1593024714000', 'archiving': '1', 'compdev': '0', 'compdevpercent': '0', 'compmax': '28800', 'compmin': '0', 'compressing': '1', 'convers': '1', 'descriptor': 'PH 1stStg Comp Mtr Current', 'digitalset': '', 'displaydigits': '-5', 'engunits': '', 'excdev': '0', 'excdevpercent': '0', 'excmax': '600', 'excmin': '0', 'exdesc': '', 'external id': None, 'filtercode':

1353
A
2 years ago
S
Stefaans ErasmusNew
asked in Open Industrial Data
Power Quality/Frequency Measurement

Hi All. I am in search of a meter that measures either the power quality of the power supplied to the Valhall platform or a measurement of the power frequency (Hz) at the Valhall Platform. TO me, it does not look like such data exists here on the OID. Am I correct?

501
A
2 years ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data
Is it possible to download the CAD files?

Hi, is is the any way to download the CAD files of the Vulkan Control Room?  Or the CAD files of any of the assests? for example the heat exchanger?  

922
L
Committed
2 years ago
A
Anonymous
published in Open Industrial Data
Hi, I'm Stig, your guide to Open Industrial Data

Hi All, I’m Stig Harald Gustavsen. For the past 15 years, I have been spending a third of my time on the Valhall oil platform. I work there as a metering technician/engineer. My daily tasks are production allocation, operating, calibrating, and maintaining the fiscal and analytical measurement systems.I’m incredibly passionate about Open Industrial Data (OID) and the concept of data sharing in general. I feel there is too little sharing of the data and information within heavy asset industrial sectors, mainly due to risk aversion. Humanity as a collective needs solutions on the industrial scale. When we withhold information, we hinder creativity and miss out on opportunities that we could leverage to create a better future together. A great example is how the internet has democratized information sharing in the commercial IT world. The more heavy asset-oriented industrial world has yet to go through this reformation. Still, I hope and wholeheartedly believe the OID is the start of this

4033
A
2 years ago
I
Practitioner
Izabela HawrylkoPractitioner
published in Open Industrial Data
Who can use Open Industrial Data?

Hello Cognite Community! Izabela Hawrylko here, Cognite’s Partner Development Director working with our Application and Industry partners. In my day-to-day work, I’m joining forces with other digital disruptors to build “Partner+Cognite” technical and go-to-market strategies for end-to-end industry solutions solving most pressing industrial challenges.I can imagine you might be wondering who Open Industrial Data (OID) is for. Anyone who is an industrial data enthusiast. Curious mind interested in better understanding the industrial reality. Are you an Independent Software Vendor building solution and applications for heavy-asset industries? Market Incumbent looking for data to experiment and drive innovation for your products and services? Researcher? Student? We have created this project for you to explore real-life industrial data streams and experiment with analytics, building new algorithms and creating visualizations.Join hundreds of other industrial data enthusiasts and dive into

2300
I
Practitioner
2 years ago
A
Anonymous
published in Open Industrial Data
Deep-dives into Open Industrial Data and how you can use it

Hi, Stig, your guide to Open Industrial Data (OID) here 👋In this article, I will introduce you to the reference data set of a industrial process system that the Open Industrial Data project contains. Analogous to what the Iris, Titanic, and gap-minder data sets are to learning data science tools, the OID project will be your entry ticket to working with industrial data. Here is a short technical description of the system on Valhall that is shared on the Open Industrial Data project. System descriptionThe data set represents the first of four stages of treatment of natural gas on the Valhall PH (Production Hotel) platform. The purpose of the gas train is to dry and compress the gas to meet the required export pressure and specification, with a total capacity of 4,06 [MSm3/d] (143 [MMscf/d]).The first stage compressor (23-KA-9101) is an electrically-driven, fixed-speed centrifugal compressor that receives gas from the separators at approximately 3 [barg] pressure. Before reaching the co

2860
A
2 years ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings