COGNITE HUB

Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 29 Topics
  • 150 Replies

29 Topics

jasar
Active
jasarActive
asked in Open Industrial Data

OID raw data

Hello,I am creating exercises for my team here at Globant, and I would like to know if it's possible to gain access to some raw data. This data would be used to train them in data extraction and normalization.Thank you for your assistance in this matter.

2
jasar
Active
2 hours ago
A
Active
Alex NarayananActive
asked in Open Industrial Data

Realtime use cases vs near realtime use cases

I’ve been introduced to CDF in the last 2 weeks, very interesting and learning through. Just wondering if CDF has been used for real time monitoring use cases, vs. predictive/BI type use cases. For example, how soon can the alerts be triggered from the time a new abnormal measurement is detected. I imagine that it depends on a lot of factors  such as network latency, source extractors, transform functions & schedules, Is there a threshold (say 1hr response time) beyond which CDF can be used.

2
A
Active
10 days ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn 360 Images

Learn 360 images in Cognite Reveal.

5
K
Seasoned
11 days ago
eberribeiro
Active
eberribeiroActive
asked in Open Industrial Data

OSDU and OID

Hi, I would like to understand the relationship of OSDU x OID? Are they competitors, the differ on, pros x cons.. Thanks in advance..

3
eberribeiro
Active
14 days ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Cognite 3D Model

Learn Cognite 3d model, focus object, fit camera, search assets highlight object etc..

27
K
Seasoned
1 month ago
T
Active
Tim HudsonActive
asked in Open Industrial Data

ArcGIS connector for CDF

We would like to have the ability to: Import directly from CDF to a geodatabase hosted in MS SQL Serverand/orHave the ability to view vector points, lines and polygons within ArcGIS Pro, ArcGIS Enterprise, and ArcGIS Online, with the ability to view and query the attribute tables, and modify symbology Have the ability to view such data in a web map either directly from a service or publish our own feature servicesA WFS may be suitable, but we would have to check with a sample service first.Can you help please?Thanks,Tim

4
gedi
Practitoner
1 month ago
Anita Hæhre
Practitioner
Anita HæhreCommunity Director
published in Open Industrial Data

What are level badges?

Hi Community Members! As we grow we're constantly looking to improve our community, and one of the changes you might notice is the new level badges. You can read more about level badges here. We hope you like it, you’ve earned it!    

100
Anita Hæhre
Practitioner
1 month ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Cognite Reveal

I work cognite reveal 3d images  in angular v12.1.1.  I using NPM  npm i @cognite/reveal@3.3.0 ,  @cognite/sdk@7.14.0 and  @cognite/potree-core@1.5.2,  Cognite reveal AxisViewTool is not working. error: (Module '"@cognite/reveal"' has no exported member 'AxisViewTool'.) 

31
K
Seasoned
1 month ago
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data

Learn Interactive engineering diagrams

https://docs.cognite.com/cdf/integration/guides/contextualization/interactive_diagrams How to create engineering diagram, and How get label name in diagram “23-LAHH-96138” through JavaScript.

17
C
Practitoner
1 month ago
R
Active
Revathi.rameshActive
asked in Open Industrial Data

Request to load OID (sample data) into our project Cognite environment

We are looking for OID and/or subset of Bootcamp data to be loaded and available in our project Cognite environment for further exploration. Can you please create a support ticket for the same?

2
Stig Harald Gustavsen
Seasoned
2 months ago
A
Committed
arianCommitted
asked in Open Industrial Data

Client id for the Python-SDK

Hello,I have a Python project that uses publicdata project of Open Industrial Data. I am trying to refactor the authentication step to use Python-SDK with OAuth since the API keys are (being) deprecated.To do so, I need the parameters token_url, client_id, client_secret, scopes.I am setting the parameters as such:cognite_tenant_id = "48d5043c-cf70-4c49-881c-c638f5796997"token_url=f"https://login.microsoftonline.com/{cognite_tenant_id}/oauth2/v2.0/authorize"client_id=???client_secret=<client secret generated from Open Industrial Data https://hub.cognite.com/open-industrial-data-211>scopes=["https://api.cognitedata.com/user_impersonation"]I would like to know if we can use the already defined Cognite tenant in AAD with Tenant Id “48d5043c-cf70-4c49-881c-c638f5796997” ? Are you providing the client id for that then? Similar to the ones publicly provided for Postman and JS-SDK? Please also note that I cannot use interactive login since it is not a one-off script.Moreover, I cannot re

13
Murad Sæter
Practitoner
2 months ago
Alex
Practitoner
AlexPractitoner
asked in Open Industrial Data

Question about data in the Open Industrial Data

Hi @Stig Harald Gustavsen , I was wondering whether you could help me understand a bit more a couple of time series related to energy consumption for cooling and compression in the first stage compressor , and also if we can see/infer the Barrel of Oil Equivalent (BOE). for instance, I do not understand the diff between this time series: VAL_23-KA-9101-M01_active_power_kW  VAL_23-KA-9101-ASP VAL_23-KA-9101-ESP  Also, I see that Valhal is powered from shore via a 294 km long DC cable with 78MW capacity from Lista, but the compressor seems to “only” consume 9MW on average - what are the other large energy consumers on Valhal ?many thanks, Alex

3
Stig Harald Gustavsen
Seasoned
2 months ago
A
Active
AndyLActive
asked in Open Industrial Data

Can't list assets in postman using OIDC

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

3
D
Practitoner
3 months ago
S
Practitoner
Shehan KarunaratnePrincipal Support Engineer
published in Open Industrial Data

OpenID Connect on Open Industrial Data

OpenID Connect is now available on Open Industrial Data (OID). When you sign up to Cognite Hub, you get an account for the Open Industrial Data project.Whether you are new to OID or have been using API keys to access the data in this project, here’s all you need to get started with OIDC.Details to create the Cognite client when using Postman and Python SDK Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - 1b90ede3-271e-401b-81a0-a4d52bea3273, project=publicdata, CDF_CLUSTER - api App name: OID-Api Note: This app registration is configured with replyURLs for Postman and to run locally in http/https.  This app registration is configured with localhost to run python SDK apps locally with http/htpps. Details to create the cognite client when using JavaScript applications Tenant ID - 48d5043c-cf70-4c49-881c-c638f5796997, Client ID - dea6bb8d-0f48-4bf0-a469-176fc19edc14, project=publicdata, CDF_CLUSTER - api App name: OID-js Note: This app registration is configur

10616
Madina Kholmatova
Seasoned Practitioner
3 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

What is the recommended approach to using the work orders for identifying events of interest?

I have been looking into many work-orders looking for failures or anomalies, but at this point I’m not sure to take the most of the shared information, as example I’ll take the two following events: The work order 6516382362467974 has the following details available:  Description: Exterior leakage - liquid for the main process Shutdown: Revision (full shutdown) Planned Start: 2014-09-11 I also plotted some of the signals from near the planned start, as shown in the below image:  I have a few questions about the first work order:   It seems that the compressor turned off about two weeks before the planned start time (As the green dotted line shows)   is it safe to assume that is discrepancy is because the two-week delay in sharing the data?  Is there a set of signals that I can look into for this work-order, I’m assuming that since there is a leakage, the time series related to lube oil could be affected, or maybe the pressure of the compressor.   The second work order is 54865032

3
Stig Harald Gustavsen
Seasoned
4 months ago
majofoal
Practitoner
majofoal
posted in Open Industrial Data

How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

4
Madina Kholmatova
Seasoned Practitioner
4 months ago
Stig Harald Gustavsen
Seasoned
Stig Harald GustavsenSeasoned
posted in Open Industrial Data

Get industrial data into Python from Open Industrial Data CDF project, thorugh OIDC auth

In this conversation I will explain / help how to access the data from the Open Industrial Data Project (OID) CDF Project, through the Cognite Python SDK, with authentication through an interactive login token from Cognite Hub’s Azure Active Directory. The video in the article will step by step show you how you can get access to the data, and also link to the relevant information you will need. Steps:1. Install or update the following python modules/librariespip install cognite-sdkpip install msalpip install pandas2. Download the publicdata.py file and store it in your python environments working directory. this file is prefilled with the OIDC ID’s and CDF project values needed to access the CDF project.3. Open a Jupyter Notebook or python file and import the publicdata.pyfrom publicdata import c4. Access the OID CDF project through the CogniteClient object: c, and when the first method is called on the CogniteClient object it will authenticate and redirect towards the AAD tenant and u

0
Stig Harald Gustavsen
Seasoned
4 months ago
S
Practitoner
Shehan KarunaratnePrincipal Support Engineer
posted in Open Industrial Data

Removing the option to use API keys for authentication in OID

OpenID Connect has been enabled on Open Industrial Data for three months.We will be removing the option to use API keys for authentication on November 1st, 2022.If you are still using API keys for authentication, please change the Authenticatioon to openID Connect. Learn how to do that in this article.

0
S
Practitoner
5 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Can the signals of warnings, alarms, and failures be used to tag anomalies and/or failures in the compressor?

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

9
Stig Harald Gustavsen
Seasoned
5 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Did the sampling frequency changed over the years?

I'm working on identifying the falling and rising edges of the VAL_23-KA-9101-M01:HSI.StatusMotorOn signal. For that and shifting the TS and rest the values, if I get -1 is a falling edge and for 1 it is a rising edge.  For the first row it works fine:  But I’m also getting a lot of values different than 1 or -1. Especially for more recent years. I guess that the problem is at the aggregating step, since I downloaded the data at a 1m frequency I get not int values for some records. Now, I was trying to download this TS at a 1s frequency, but I get a different number of records depending on the year.  E.G. for 2014 I get 34 records for a 10 days time windows with a granularity 1m.  If I do the same but for 2020 I get 1411, much more than for 2014, but still a tenth of the expected count.  If I change the granularity to 1s, I still get the same number of records, but with more precision in the time stamp:   Considering this, is there a recommended granularity to download the data and min

2
G
Seasoned Practitioner
5 months ago
Sverre Fjerdingstad
Practitoner
Sverre FjerdingstadCognite Academy Instructor
posted in Open Industrial Data

Cognite Data Fusion for Domain Experts

This discussion is linked to the course Cognite Data Fusion for Domain Experts.A data-driven approach to maintenance is more efficient than relying on a fixed schedule or fixing something once it’s already broken. There are plenty of opportunities around us to take advantage of smart maintenance. Look around in your home, your office, or think of your work tasks. Where could data-driven maintenance make a difference?Share your thoughts! For example, explain what data you have available or would need in order to do smart maintenance, and how this would be an improvement of current methods. 

4
L
Committed
5 months ago
Madina Kholmatova
Seasoned Practitioner
Madina KholmatovaCognite Academy Instructor
posted in Open Industrial Data

Explore a Live Stream of Industrial Data with Power BI!

Do you know what courses are available for you to explore the data from the Open Industrial Data project?Cognite Academy creates e-learning courses with an emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data. In most of our courses, the training data we use comes from the Open Industrial Data (OID) project, a live stream of industrial data from the Valhall oil platform. While the data is from the oil and gas industry, it is relevant for all asset-heavy industries as it provides insights into dynamic industrial processes. In this article, I will share a series of CDF & Power BI courses where you can explore the Open Industrial Data and solve a simple use case in Power BI: Introduction to CDF & Power BI  In this course, you will connect Power BI to CDF, and retrieve the Open Industrial Data to learn how filtering and aggregation work with the connector in Power BI.  CDF & Power BI: Solving

1
Madina Kholmatova
Seasoned Practitioner
5 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Where can I get the measurement units of the sensor data?

I'm working with the time series data for anomaly detections models and I would like to know the units of the sensor data. I found a master thesis based on the Open Industrial Data and for the variables selected for it; the author specifies the units:  But from the data I downloaded with the SDK the tag VAL_23_KA_9101_M01_62C:Z.X.Value     does not have unit:  I looked into the meta data field an the engunits key is empty:{'P&ID No': None, 'PLC': None, 'PLC tagname': None, 'Sensor type': None, 'Tag group': None, 'Tag type': None, '_replicatedInternalId': '4326942079596138', '_replicatedSource': 'akerbp', '_replicatedTime': '1593024714000', 'archiving': '1', 'compdev': '0', 'compdevpercent': '0', 'compmax': '28800', 'compmin': '0', 'compressing': '1', 'convers': '1', 'descriptor': 'PH 1stStg Comp Mtr Current', 'digitalset': '', 'displaydigits': '-5', 'engunits': '', 'excdev': '0', 'excdevpercent': '0', 'excmax': '600', 'excmin': '0', 'exdesc': '', 'external id': None, 'filtercode':

3
A
6 months ago
S
Stefaans ErasmusNew
asked in Open Industrial Data

Power Quality/Frequency Measurement

Hi All. I am in search of a meter that measures either the power quality of the power supplied to the Valhall platform or a measurement of the power frequency (Hz) at the Valhall Platform. TO me, it does not look like such data exists here on the OID. Am I correct?

1
A
6 months ago
L
Committed
Luis Ramon Ramirez RodriguezCommitted
asked in Open Industrial Data

Is it possible to download the CAD files?

Hi, is is the any way to download the CAD files of the Vulkan Control Room?  Or the CAD files of any of the assests? for example the heat exchanger?  

2
L
Committed
6 months ago

Generate client secret for OID

Please generate a client secret once every 180 days.




Badge winners

  • Cognite Data Fusion Fundamentals
    uertenhas earned the badge Cognite Data Fusion Fundamentals
  • Working with Cognite InField
    Gustavo Nunezhas earned the badge Working with Cognite InField
  • Cognite Data Fusion Bootcamp
    davidchoihas earned the badge Cognite Data Fusion Bootcamp
  • Cognite Data Fusion Bootcamp
    kevinpenghas earned the badge Cognite Data Fusion Bootcamp
  • Domain Expert Basics
    Laura Creangahas earned the badge Domain Expert Basics
Show all badges
Terms & ConditionsCookie Settings