Open Industrial Data

Hi, I’m Enikö Farkas from Cognite. With my team, we create e-learning for Cognite Academy. In our courses, we put a lot of emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data.In most of our courses, the training data we use comes from the Open Industrial Data (OID) project which is the result of a collaboration between Aker BP, one of Europe’s largest independent oil companies, and Cognite. While the data is from the oil and gas industry, its relevance is much broader: it gives us insight into dynamic industrial processes and can inspire all industries.In this article, I’m excited to share more about this project.About the dataThe data originates from a single compressor on Aker BP’s Valhall oil platform in the North Sea. Aker BP selected the first stage compressor on the Valhall because it is a subsystem with clearly defined boundaries, rich in time series and maintenance data.AkerBP uses Cognite Data Fus

Are there any extractors or connectors to seamlessly integrate Cognite CDF and Aspentech Mtell?If not, have you discussed approaches for that integration, and whether one of them should involve using Aspentech DataSource Interfaces to connect via Aspentech ODBC Datasource, Kafka Datasource, or MQTT Datasource?Please also share any other approaches you may have discussed for seamlessly integrating CDF and Aspentech Mtell.

What are the licensing terms and conditions for using Cognite's Open Industrial Data? Could you please provide a link to these terms and conditions?Thank you.

There are some signals that in the names or the description have the words: alarm, warning, or fault. E.G. There is this alarm signal, (in red ) that I’m comparing with one of the vibration signals.  And the alarm seems to be on when the vibrations are close to 0 and the Compressor is off. I’m plotting the label as a combination of the name and the description, but the externalId of the alarm is: pi:160268In most cases that alarm is on when the compressor is off, except in this case, Where I do not see any problem with the vibration signal: There are these other two alarms, from the plots: one is on when the compressor is off and the other one when it is starting up. But I do not see any strange behavior in the signal when they occur. Besides the alarms, I’ve also looked into some of the fault signals but those seem to be on for very long times: Is there another way to use the alarm and fault signals to label anomalies or failures? I don’t know if using the vibration signals is the bes

I checked the Data Management UI in CDF Fusion. There is a list of data models in the PublicData project.There, I found the Cognite Core Data Model, where the schema is well-defined, but the instance has no data.I want to explore a GraphQL query using this data model—for assets with their hierarchy and related entities such as time series and files.However, since there is no data, I am not sure how to proceed. Could you please guide me on how to solve this?if we need transform data we need permission for the write  

app.cognite.service: Found 1 data modelIn the publicdatacdm space, only one data model is currently available, which is related to 3D scenes.However, our goal is to create a knowledge graph, which requires asset-related data models. Since the available model is focused on 3D scene configuration, it doesn't cover the necessary asset relationships.To move forward with building a knowledge graph, we need: Asset-centric data models. A clustering mechanism to visualize and structure the knowledge graph meaningfully. Is there any plan to include asset-related models in publicdatacdm, or any recommended approach to achieve this with the current setup?

Hi Cognite Community,I'm building a React + TypeScript app using Apollo Client to connect to the CDF GraphQL API. It shows a Knowledge Graph of assets, time series, P&ID diagrams, and 3D models using vis-network.✅ I already did this successfully using the Python SDK.Now, I need help with:Setting up the GraphQL endpoint in ReactHandling authentication from the frontendAny simple examples or tips would be greatly appreciated. Thanks!

H ​@Mithila Jayalath ,Can you please grant relationship API permissions in the Python SDK?I am getting this error:Could not fetch relationships: User does not have relationships permissions. code: 403 | X-Request-ID: 10dc4192-f4f6-91e1-9c0c-929eefa8bd15 | cluster: api | project: publicdatacdm

Hi,First of all, where can we get the OID Project public data API documentation, and what are the parameters we need to pass to fetch the data?My aim is to use OID public data to access any asset — for example, a pump set — and display its data and health status on a dashboard. The dashboard will be built using React, and for the backend we can use FastAPI with the Cognite SDK.

hi guys,  can you please tell me the reason of the error below while API testing in Postman:any help is very much appreciated 

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

Hi everyone,I’m facing a challenge with our current setup and would appreciate some guidance from the community.We have an OPC-UA server running on a Siemens IPC Linux machine, which serves the variable values of a Siemens PLC. This OPC-UA server is queried by an OPC-UA client inside a Docker package (Cognite OPCUA Extractor) that sends the data to Cognite Data Fusion (CDF). The data points are then stored in their respective time series within CDF.The issue is that, during periods when the physical quantity doesn’t change (e.g., motor current at zero during weekends), no new data points are sent to CDF. As a result, when the motor starts again, and the current shoots up quickly (for example, up to 2 Amps in 40 ms), this rapid change is not properly reflected in the time series. Because we only scan every 100 ms with the PLC, and since no data was logged during the weekend, it appears in CDF as though the current gradually increased from 0 to 2 Amps over the entire weekend. This is cau

Hi everyone, I am wondering if someone can help explain the difference between Node/Edge and View/Connection Properties. I am extremely confused on these concpts as I read through the CDF data modelling tutorial.My current perspective is that Node/Edge and the knowledge graph defined by Nodes and Edges is the most “vanilla” version. Where as a Data Model made up of Views and Connection Properties is a similar construct but based on a specific perspective. The analogy between a View and Node in a relational DB sense will be a table and a view.Is my understanding correct? If so, I am wondering what is the actual need of Node/Edge given there is already Containers that perform the data storage like a SQL table would do? It seems to me that View, Connection Properties and Data Models are sufficient enough to produce any type of sementic model?

Recently came across articles on MAD and several variations of ESD test for detecting local vs. global anomalies (outliers) in time series data. Anyone has any experiences with such algorithms and any words of wisdom on how to utilize such algorithms to detect local anomalies? Thank you very much,Is there any benefit other than MAD being more robust (to outliers) than Standard Deviation? what about ESD?

How can I read vibration data in the Open Industrial Dataset? I have tried different options (GUI, via SDK) the response is blank (i.e., no data). Is there any trick or any particular setting for reading vibration data? thank you very much.

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

The only thing holding back innovation is the ability to integrate data from various sources into a single destination that processes that data agnostically.  The untapped and currently useless data around me is astonishing.  We could be measuring the workloads of LED's in TVs, vibration in Hard drives, the wattage of plugs, the efficiency of lights, on and on. The sensors can be made or integrated without much issue, the problem lies in getting that data to the correct processing application that then handles that data in a manner that produces meaningful insights.  We are on the cusp here of finding an agnostic methodology to handling data and at that point it will be a race to ease -of -use, visual beauty and price.

I’m currently writing my Master thesis in collaboration with Aize (represented by V. Flovik), where I’m trying to use Generative adversarial Networks (GAN) to generate synthetic time series data. To do this, I’m using data from Cognite OID. I’ve explored the data in the previous semester, and I figured that one of my main challenges is to find longer periods of data that are “Normal”. Meaning periods without to large irregularities and without too many missing data points. Because even when I aggregate the samples over 30 seconds, there are still samples missing in some periods. Some of these periods are hours long and can’t really be filled in without messing up the temporal development of the data. I can’t find any information about the cause of these periods either.The time series I’ve been looking at are:I’m no expert in process engineering, and I only chose these 9 sensors because another master thesis from 2019 had used these sensors in their project. I therefore reach out here t

When I look at event data, I mostly see***  ( i think this is like NULL or NaN - not filled)see some worktask, rule_broken. Condition, etc.I am new to open industrial data. Thinking of using it for a Thesis, etc. Is there a way to get the different event “types” - i tried scrolling, api is not working well for me. Any advice on this front would be greatly appreciated. Thank you very much. 

We would like to have the ability to: Import directly from CDF to a geodatabase hosted in MS SQL Serverand/orHave the ability to view vector points, lines and polygons within ArcGIS Pro, ArcGIS Enterprise, and ArcGIS Online, with the ability to view and query the attribute tables, and modify symbology Have the ability to view such data in a web map either directly from a service or publish our own feature servicesA WFS may be suitable, but we would have to check with a sample service first.Can you help please?Thanks,Tim

Hi team, I am trying to connect CDF as data source to Grafana but i am unable to do that i am  getting Authentication to data source failed error.I am using same oauth credentials which were i used before in python sdk to extract assets and time series data but in this case  those credentials are not working . My doubt is am I need to register new application in microsoft azure entra id or not?????

I’m working on cognite-learn account and want to access api key to ingest data into cognite. where can I find this.

Failed to resolve 'CraftBrewData.brew_assets'. API responded with: 403 Subject does not have 'READ' action for one of the specified tables. Getting the above error when I try do any transform on raw tables. Using default credentials which generate when I press run