Skip to main content

Open Industrial Data

Explore a live stream of real industrial data from the Open Industrial Data Project. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 47 Topics
  • 222 Replies
47 Topics
Maria Fonseca
Seasoned Practitioner
Maria FonsecaSeasoned Practitioner
posted in Open Industrial Data
How to generate a client secret for Open Industrial Data?

In Open Industrial Data (OID), we have moved away from API keys. Open Industrial Data currently supports Open ID connect. You can check out more on how to configure OpenID Connect on Open Industrial Data.If you are planning to use OID and authenticate using client credentials flow, you will need a client secret from the app registration on the Azure Active Directory. Go to Open Industrial Data and you will observe there is a widget for generating a new client secret IDIn the drop down, you can select two options:Other: Use this if you are using Postman or Python SDK Javascript: Select this option if your app is in JavascriptOnce you click on Create client secret, this will be display just once. Make sure to save it somewhere safe.Let me know if you have any questions 🙂

129413
C
Active
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
published in Open Industrial Data
OpenID Connect on Open Industrial Data

OpenID Connect is now available on Open Industrial Data (OID). When you sign up to Cognite Hub, you get an account and can access both the publicdatacdm and publicdata projects.Whether you are new to OID or have been using API keys to access the data in this project, here’s all you need to get started with OIDC. Connection DetailsThe credentials for each project are listed below. Please use the details corresponding to the project you wish to access. For the publicdatacdm Project Details for Postman and Python SDK: Tenant ID: 48d5043c-cf70-4c49-881c-c638f5796997 Client ID: 1b90ede3-271e-401b-81a0-a4d52bea3273 project: publicdatacdm CDF_CLUSTER: api App name: OID-Api Note: This app registration is configured with replyURLs for Postman and to run Python SDK apps locally with http/https.Details for JavaScript Applications: Tenant ID: 48d5043c-cf70-4c49-881c-c638f5796997 Client ID: dea6bb8d-0f48-4bf0-a469-176fc19edc14 project: publicdatacdm CDF_CLUSTER: api App name: OID-js

297612
I
Active
APSHANKAR Sagar
Committed
APSHANKAR SagarCommitted
asked in Open Industrial Data
OPC-UA extractor - docker settings for periodic reporting of values regardless of change

Hi everyone,I’m facing a challenge with our current setup and would appreciate some guidance from the community.We have an OPC-UA server running on a Siemens IPC Linux machine, which serves the variable values of a Siemens PLC. This OPC-UA server is queried by an OPC-UA client inside a Docker package (Cognite OPCUA Extractor) that sends the data to Cognite Data Fusion (CDF). The data points are then stored in their respective time series within CDF.The issue is that, during periods when the physical quantity doesn’t change (e.g., motor current at zero during weekends), no new data points are sent to CDF. As a result, when the motor starts again, and the current shoots up quickly (for example, up to 2 Amps in 40 ms), this rapid change is not properly reflected in the time series. Because we only scan every 100 ms with the PLC, and since no data was logged during the weekend, it appears in CDF as though the current gradually increased from 0 to 2 Amps over the entire weekend. This is cau

632
APSHANKAR Sagar
Committed
K
Active
Kai KangActive
asked in Open Industrial Data
Difference between Node/ Edge and View/Connection Properties

Hi everyone, I am wondering if someone can help explain the difference between Node/Edge and View/Connection Properties. I am extremely confused on these concpts as I read through the CDF data modelling tutorial.My current perspective is that Node/Edge and the knowledge graph defined by Nodes and Edges is the most “vanilla” version. Where as a Data Model made up of Views and Connection Properties is a similar construct but based on a specific perspective. The analogy between a View and Node in a relational DB sense will be a table and a view.Is my understanding correct? If so, I am wondering what is the actual need of Node/Edge given there is already Containers that perform the data storage like a SQL table would do? It seems to me that View, Connection Properties and Data Models are sufficient enough to produce any type of sementic model?

1033
APSHANKAR Sagar
Committed
S
Committed
sridiyerCommitted
asked in Open Industrial Data
Median Absolute Deviation (MAD) and Twitter's ESD test

Recently came across articles on MAD and several variations of ESD test for detecting local vs. global anomalies (outliers) in time series data. Anyone has any experiences with such algorithms and any words of wisdom on how to utilize such algorithms to detect local anomalies? Thank you very much,Is there any benefit other than MAD being more robust (to outliers) than Standard Deviation? what about ESD?

472
S
Committed
S
Committed
sridiyerCommitted
asked in Open Industrial Data
Reading Vibration Data

How can I read vibration data in the Open Industrial Dataset? I have tried different options (GUI, via SDK) the response is blank (i.e., no data). Is there any trick or any particular setting for reading vibration data? thank you very much.

842
S
Committed
A
Active
AndyLActive
asked in Open Industrial Data
Can't list assets in postman using OIDC

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

1864
Elcio Cardoso da Silva
Committed
C
Active
Cameron DuffyActive
asked in Open Industrial Data
Licensing Terms and Conditions - Open Industrial Data

What are the licensing terms and conditions for using Cognite's Open Industrial Data? Could you please provide a link to these terms and conditions?Thank you.

964
Sofie Haug
Seasoned Practitioner
Andre Alves
MVP
Andre AlvesMVP
asked in Open Industrial Data
CDF and Aspentech Mtell Integration

Are there any extractors or connectors to seamlessly integrate Cognite CDF and Aspentech Mtell?If not, have you discussed approaches for that integration, and whether one of them should involve using Aspentech DataSource Interfaces to connect via Aspentech ODBC Datasource, Kafka Datasource, or MQTT Datasource?Please also share any other approaches you may have discussed for seamlessly integrating CDF and Aspentech Mtell.

634
T
Seasoned Practitioner
T
Active
Tim CorcoranActive
posted in Open Industrial Data
Data from Everywhere

The only thing holding back innovation is the ability to integrate data from various sources into a single destination that processes that data agnostically.  The untapped and currently useless data around me is astonishing.  We could be measuring the workloads of LED's in TVs, vibration in Hard drives, the wattage of plugs, the efficiency of lights, on and on. The sensors can be made or integrated without much issue, the problem lies in getting that data to the correct processing application that then handles that data in a manner that produces meaningful insights.  We are on the cusp here of finding an agnostic methodology to handling data and at that point it will be a race to ease -of -use, visual beauty and price.

400
T
Active
F
Active
Fredrik SveenActive
asked in Open Industrial Data
Time series suited for generating synthetic data with GANs

I’m currently writing my Master thesis in collaboration with Aize (represented by V. Flovik), where I’m trying to use Generative adversarial Networks (GAN) to generate synthetic time series data. To do this, I’m using data from Cognite OID. I’ve explored the data in the previous semester, and I figured that one of my main challenges is to find longer periods of data that are “Normal”. Meaning periods without to large irregularities and without too many missing data points. Because even when I aggregate the samples over 30 seconds, there are still samples missing in some periods. Some of these periods are hours long and can’t really be filled in without messing up the temporal development of the data. I can’t find any information about the cause of these periods either.The time series I’ve been looking at are:I’m no expert in process engineering, and I only chose these 9 sensors because another master thesis from 2019 had used these sensors in their project. I therefore reach out here t

1141
Dilini Fernando
Seasoned Practitioner
S
Committed
sridiyerCommitted
asked in Open Industrial Data
How to interpret event data in open industrial data

When I look at event data, I mostly see***  ( i think this is like NULL or NaN - not filled)see some worktask, rule_broken. Condition, etc.I am new to open industrial data. Thinking of using it for a Thesis, etc. Is there a way to get the different event “types” - i tried scrolling, api is not working well for me. Any advice on this front would be greatly appreciated. Thank you very much. 

542
Dilini Fernando
Seasoned Practitioner
T
Committed
Tim HudsonCommitted
asked in Open Industrial Data
ArcGIS connector for CDF

We would like to have the ability to: Import directly from CDF to a geodatabase hosted in MS SQL Serverand/orHave the ability to view vector points, lines and polygons within ArcGIS Pro, ArcGIS Enterprise, and ArcGIS Online, with the ability to view and query the attribute tables, and modify symbology Have the ability to view such data in a web map either directly from a service or publish our own feature servicesA WFS may be suitable, but we would have to check with a sample service first.Can you help please?Thanks,Tim

2446
T
Committed
R
Active
RAMOJIActive
asked in Open Industrial Data
How to configure CDF as datasource to grafana

Hi team, I am trying to connect CDF as data source to Grafana but i am unable to do that i am  getting Authentication to data source failed error.I am using same oauth credentials which were i used before in python sdk to extract assets and time series data but in this case  those credentials are not working . My doubt is am I need to register new application in microsoft azure entra id or not?????

1183
Dilini Fernando
Seasoned Practitioner
S
Active
Siyyala Narendra 12Active
asked in Open Industrial Data
Cognite API key for learn account

I’m working on cognite-learn account and want to access api key to ingest data into cognite. where can I find this.

1093
Dilini Fernando
Seasoned Practitioner
J
Active
jheinebergActive
asked in Open Industrial Data
Transform Fails on Read

Failed to resolve 'CraftBrewData.brew_assets'. API responded with: 403 Subject does not have 'READ' action for one of the specified tables. Getting the above error when I try do any transform on raw tables. Using default credentials which generate when I press run

553
J
Active
Andre Alves
MVP
Andre AlvesMVP
asked in Open Industrial Data
Extracting asset data from engineering data sources like PI&D documents

We are delving into the specifics of using Cognite for certain use cases and have identified the necessity for automatically extracting asset data from engineering data sources like PI&D documents. Are there any features available to facilitate this?For instance, our clients possess numerous PI&D documents and require automatic generation and structuring of asset hierarchies.

1303
Andre Alves
MVP
V
Active
VamsiGrandhiActive
asked in Open Industrial Data
Custom Data Selection Granularity

When we are selecting different date range, the granularity is changing for different number of days selection. For 2 days - 3min; For 3 days - 5min.Can we get access to any document how this pattern is designed. 

725
Dilini Fernando
Seasoned Practitioner
R
Seasoned
Raluca BalaSeasoned
asked in Open Industrial Data
Aker BP

Hello! Is there a repository where the Aker BP open data is available for direct download? ( asset hierarchy, work orders, P&ID file)? 

1892
R
Seasoned
Ehab Hussein
Committed
Ehab HusseinCommitted
asked in Open Industrial Data
Cybersecurity and CDF

what is cybersecurity or data governed for moving data from Datasource in customer site to CDF ?

503
Ehab Hussein
Committed
E
Seasoned Practitioner
Eniko FarkasCognite Academy Instructor
published in Open Industrial Data
What is Open Industrial Data?featured

Hi, I’m Enikö Farkas from Cognite. With my team, we create e-learning for Cognite Academy. In our courses, we put a lot of emphasis on providing hands-on experiences so you can learn to use Cognite Data Fusion through interacting with real industrial data.In most of our courses, the training data we use comes from the Open Industrial Data (OID) project which is the result of a collaboration between Aker BP, one of Europe’s largest independent oil companies, and Cognite. While the data is from the oil and gas industry, its relevance is much broader: it gives us insight into dynamic industrial processes and can inspire all industries.In this article, I’m excited to share more about this project.About the dataThe data originates from a single compressor on Aker BP’s Valhall oil platform in the North Sea. Aker BP selected the first stage compressor on the Valhall because it is a subsystem with clearly defined boundaries, rich in time series and maintenance data.AkerBP uses Cognite Data Fus

28492
E
Seasoned Practitioner
I
Active
Ishita MathurActive
asked in Open Industrial Data
error 400 while testing postman API

hi guys,  can you please tell me the reason of the error below while API testing in Postman:any help is very much appreciated 

1283
Andre Alves
MVP
N
Committed
nabanitakarCommitted
asked in Open Industrial Data
How to keep Master data in CDF

How to keep Master data in CDF: the data which is not part of any asset hierarchy 

895
C
Seasoned Practitioner
K
Seasoned
Karthik KaliyaperumalSeasoned
asked in Open Industrial Data
Learn Interactive engineering diagrams

https://docs.cognite.com/cdf/integration/guides/contextualization/interactive_diagrams How to create engineering diagram, and How get label name in diagram “23-LAHH-96138” through JavaScript.

25320
Andreea Oprea
Seasoned Practitioner
D
Seasoned
Diana Chimnaz JohanSeasoned
asked in Open Industrial Data
Manually load excel/csv files to CDF

I have csv files with asset information, asset hierarchy, time series objects and timeseries datapoints. I would like to load these to CDF and link to a dataset. Could someone walk me through this or refer me to some help files? 

1781
E
Practitioner

Badge winners

  • Cognite Data Engineer Basics - Integrate
    Priyansjhas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Fusion Fundamentals
    Priyansjhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Engineer Basics - Integrate
    yuri.servediohas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Engineer Basics - Integrate
    PRACHI RAJ SINGHhas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Fusion Bootcamp
    wkhwanmuanghas earned the badge Cognite Data Fusion Bootcamp
Show all badges
NEWSLETTER ARCHIVES
Terms & ConditionsCookie Settings