Groups
- - Knowledge Base
Product Updates
Product Ideas
Docs
Events
Academy
Partners

Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...

(Mon, 14 Oct, 2:00 pm)

Home
Community overview
Community Discussions

Community Discussions

Join the conversations to shape a safer, more efficient, and sustainable industrial future!

986 Topics

Recently active

Most replies Most views Newest first

Markus PettersenCommitted

posted in Developer and User Community

CDF API: Shared compute resources across tenants causing problems - dev tenant breaks the prod tenant

Hi there,Before I begin, some terminology to make sure we are on the same page.CDF tenant = CDF project (these have been used interchangeably over time, not sure which is applicable at the moment, I will be referring to it as tenant)CDF cluster = The cloud cluster where the CDF tenants/projects/instances are hostedNow, let’s begin.At Aker BP we have been migrating over to a dedicated CDF cluster on Azure and we have been experiencing some pain points with regards to the compute resources being shared for all tenants on the cluster. Previously our CDF tenants were hosted on GCP on a cluster shared with other companies, this cluster is scaled to handle multiple customers and so the base scaling of the compute resources is much higher than it would be on a dedicated cluster, and as such these problems are less likely to be encountered, not impossible just not as likely. The problem we have seen is that if we from our dev tenant overload the API then the API becomes unavailable for all our

1 hour ago

Joy BaruaActive

asked in Developer and User Community

Need to Ingest Files(images and others) from a Azure Blob Storage using the SAS Url provided.

Hello All,i am trying to configure an extractor to retrive files from Azure Blob Storage.the Client has shared a URL(SAS) to access it directly. i can add it to the Azure Storage explorer and view the nested folders.I am trying to find a way to injest the image and other files from a specific folder. Please be advised that the folder size is around 500GB. so i need to find a way to run the extractor smoothly.@Aditya Kotiyal @Dushyant Singh Shekhawat @Karan Bhatia

11 hours ago

Shreyas MehtaSeasoned

asked in Developer and User Community

Core data models support in SDK

As Core data models are GA, I am assuming that they are available in SDK. Request to point me to the link.

17 hours ago

Anders NygaardCommitted

asked in Developer and User Community

Javascript SDK: getToken runs only some of the time when using CogniteClient

Across multiple javascript projects, we use the @cognite/sdk. We observe some strange behaviour when it comes to authentication and see the Chrome network panel full of HTTP 401 calls. When debugging the issue, we see that the getToken method supplied to the CogniteClient class only gets called some times. And when it does, the code on our part successfully retrieves a valid token. This leads to some unwanted behaviour and the user sometimes needs to refresh the browser in order to correct the browser state.I suspect the fact that we make a new instance of CogniteClient everytime we use it could be the culprit. I read from the source code baseCogniteClient.ts that the getToken function is not called each time in order to “To prevent calling `getToken` method multiple times in parallel”. Not that I am really able to follow this behaviour over multiple instances of the client.Any pointers as to what might cause this problem?const getToken = async () => { // this code only hits some t

20 hours ago

Sverre FjerdingstadCognite Academy Instructor

posted in Open Industrial Data

Cognite Data Fusion for Domain Experts

This discussion is linked to the course Cognite Data Fusion for Domain Experts.A data-driven approach to maintenance is more efficient than relying on a fixed schedule or fixing something once it’s already broken. There are plenty of opportunities around us to take advantage of smart maintenance. Look around in your home, your office, or think of your work tasks. Where could data-driven maintenance make a difference?Share your thoughts! For example, explain what data you have available or would need in order to do smart maintenance, and how this would be an improvement of current methods.

1 day ago

APSHANKAR SagarCommitted

posted in Developer and User Community

Sequences vs Events vs FDM

Hello,I am trying to understand the difference between Sequences and Events to see what is pertinent for me in a specific use case. For me, both of them allow saving a native CDF object along with a timestamp, enriched with other data. I feel like we can also achieve the same goal by making a data model with timestamps in one column and all the properties we are interested in, in other columns; though this approach would be harder because it would necessitate using pygen for input output. In my company, we work on Industrial processing lines. At any given moment, a line is operating under a set of conditions, defined by a fixed set of set points, like ‘conveyor speed’ and various temperatures. Let us call the set points a, b, c etc. For set points a, b and c, we have measured values i, j and k.To assess whether the machine is operating normally, we want to compare the aggregated measurements (i-j-k) taken during a period when the set points are a-b-c with a previous instance when the

1 day ago

HanishSharmaPractitioner

asked in Developer and User Community

Data from Real-time Streaming Protocol (RTSP) into CDF

Hello Cognite experts, I trying to find our some reference material to explore regarding integrating data from RTSP in Cognite. Are there any workflows/POC/documentation/examples available for this data source?

3 days ago

dinesh.makkedSeasoned

asked in Developer and User Community

How to use parameterized query in the DB-Extractor?

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable. SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated. Thanks,Dinesh

4 days ago

Andreea Elena BalcosActive

asked in Developer and User Community

Hosting pickle file in CDF

Hello,Is it possible to host a pickle file (which contains a ML model) in CDF and use it to make predictions for the available data in the platform?If yes, what are the steps ? I browsed the documentation but I haven’t found anything relevant

4 days ago

Andre AlvesPractitioner

posted in Developer and User Community

Predictive Maintenance Model - Real-Time Inference

In some AI demos built on top of Cognite, our approach to real-time inference involves retrieving the latest time series values for the equipment. Since our machine learning models are deployed and running on a cluster outside Cognite, we leverage the SDK to handle real-time inference by retrieving the most recent data as follows:real_time_data_bomb_hfx = cdf_client.time_series.retrieve_latest(id="bomt_hfx_time_series_id")Is anyone working with a different approach to send new data for inference to their machine learning models? I'd be interested in hearing how others are managing this process.We are also exploring more resilient approaches, such as: Streaming Data for Real-Time Inference (Event-Driven Approach): We plan to test Cognite's Kafka extractor as soon as possible to enable more seamless streaming. On-Demand Inference via API: While this approach is synchronous, which has caused challenges for us in the past, we prefer to avoid this method and lean toward more asynchronous

4 days ago

sridiyerActive

asked in Developer and User Community

Decoder only time series models like TimesFM (google), Lag-Llama, Moirai

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.

5 days ago

Chris SelphSeasoned

asked in Digitalization Community

Entity Matching Select All when using filters

When using Entity Match/Quick Match, the user cannot “Select All” matching Events (or Timeseries) when applying an additional filter. The check box is grayed out. Pretty frustrating. Am I missing something?

5 days ago

Anders BrakestadSeasoned

asked in Developer and User Community

Is it possible to specify whether time series data is aggregated at "start", "midpoint", or "end"?

I am making comparisons between time series data in CDF and PI. The reason is that in our tenants the CDF data is not 100% accurate compared to PI.However, from my testing I think that PI performs its aggregations with the timestamps “centered” at the aggregated time periods, while CDF puts the timestamps at the start of each aggregated period. Is it possible to specify how this is done with the Python API? From my study of the docs it appears not to be the case. The same applies to the PI Web API as well: I cannot specify how the timestamps are placed. The agreement with PI becomes significantly better if I place the CDF timestamps at the center of the aggregated time periods.My current workaround is the following:Fetch RAW data from CDF Shift the timestamps by 0.5x of the granularity Resample to the desired granularity Compute mean Interplate any missing valuesThe issue is that fetching raw data is a lot more time consuming than fetching aggregates. I have been playing with fetching

5 days ago

Akshay HandeCommitted

asked in Developer and User Community

Parallel task execution not deleting some of the tables from Raw db

Hi,I am running parallel tasks(Cognite functions) in Cognite workflows. One of the task is creating table in Raw db, where as other one is deleting the table. Whatever table is create, its name is passed as input to other function deleting it.First attempt I ran 150 parallel tasks in a 10 workflows(each 15 tasks). One table was not deleted from raw db In second attempt I ran 200 parallel task in 10 workflows(each 20 tasks). In this case 8 tables were not deleted from rawI was not able to debug why those table not get deleted. As the delete function status was showing ‘Completed’ on Cognite UI.Can you please help why this tables are not getting deleted? If there is a limit of parallel task execution then how to exceed this limit? And how to debug this scenario where there is no function execution failure?Attaching the test workflow for reference. Run workflow-deploy-job.py file to deploy workflow on cognite project. Edit functions.json and workflow-deploy-job.py files for replacing cog

5 days ago

KarinnensantosSeasoned

asked in Developer and User Community

Downloading Canvas Page

Hey Guys, I would like to know when will be possible download the Canvas Page.

6 days ago

Pablo PalaciosSeasoned

asked in Developer and User Community

Excel Extractor

Hello:I am using DB Extractor v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file: databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me?

7 days ago

Anders BrakestadSeasoned

asked in Developer and User Community

Power BI: Use parameter to specify CDF tenant when querying Sequences with Cognite Extractor

Hi guys! We are developing a Power BI dashboard that relies on time series and sequences fetched from CDF using the Cognite Extractor. We have set up a deployment pipeline for our dashboards (Dev, Test, and Prod), where each environment in the PBI pipeline corresponds to data sources in the respective CDF tenant. I.e., our Dev dashboard reads data from our dev tenant in CDF, and so on. We get this to work by configuring a Parameter in Power BI desktop with values that match our CDF tenants.Then we refer to these parameters when we define the data sources. Here is an example of how we use push-down filtering via OData queries from the Advanced Editor in Power Query:Source = Cognite.Contents(cdf_env & "/Timeseries/?$filter=ExternalId eq 'our_special_external_id'", null),The variable “cdf_env” evaluates by default to Dev, and we have configured the deployment pipeline such that this parameter updates automatically when we deploy from Dev to Test, and from Test to Prod. But here is the

8 days ago

Kristian NymoenSeasoned

posted in Developer and User Community

KPIs on the use and adopion of CDF in the company

Hi all.We’re working on defining KPIs to track our digitalization journey, and think that a KPI on the use and adoption of CDF as opposed to “the old way of doing things” would be useful. I’m posting here in an attempt to hear if the CDF customer community can provide inspiration for how to ensure success and good adoption of CDF among users. Does anyone have thoughts to share on their own metrics for CDF usage?My thoughts so far are tracking the number of unique users logging in to Fusion/Charts, number of API calls against CDF, etc. Although I have not found any direct way as a customer to obtain this information. The Sessions API endpoint could possibly be a place to start?And as a follow-up question; CDF usage in itself is a quite indirect metric on the digital maturity of the business, and on acheived value. My ideal goal would be to find a more direct higher level metric for the entire company, which is not as indirect as user log-ins, and also not as narrow as value obtained for

8 days ago

Ajay GaurActive

asked in Developer and User Community

Can we Keep OPC-UA Real time Data to CDF RAW Tables (Other than meta data)?

Can someone tell me about this. if i Want to keep OPC UA realtime data into cdf RAW using opc ua extractor?

8 days ago

Neerajkumar BhatewaraSchlumberger

asked in Developer and User Community

Not able to see the Cognite in Authenticator

Hello I was having the Authenticator setup for logging to zendesk and other cognite sites. But somehow its not there on my mobile now. can you help with re-registering ?my id - nbhatewara@slb.com Neeraj B

9 days ago

adrianosvieiraActive

asked in Developer and User Community

How insert time series dapoint works

I am doing some hands-on exercises, but I am stuck in a point here.The task is to Add some time series data:- Create a time series object for each country asset in CDF called <country>_population and associate it with its corresponding country asset. Remember to associate the data as well to the data set that you created. As an example, the time series for Aruba would be called Aruba_population.- Load the data from populations_postprocessed.csv into a pandas dataframe.- Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe.- As a check, retrieve the latest population data for the countries of Latvia, Guatemala, and Benin.- Calculate the total population of the Europe region using the Asset Hierarchy and the time series data.The point I stuck on:=> “Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe”. I am not sure what does this means, although I had done an early exercise …“Insert th

11 days ago

Cameron DuffyActive

asked in Open Industrial Data

Licensing Terms and Conditions - Open Industrial Data

What are the licensing terms and conditions for using Cognite's Open Industrial Data? Could you please provide a link to these terms and conditions?Thank you.

11 days ago

Asha SankaranarayananPractitioner

published in Digitalization Community

🚨 Big News from Cognite's Security Team! 🚨

We’re excited to announce that Cognite is now officially listed on the CSA STAR Registry at Level 1! 🌟Cloud Security Alliance (CSA) STAR Registry is a trusted benchmark in cloud security, providing a comprehensive view of the security practices of cloud service providers. Being included in this registry means that Cognite meets the highest standards of security, transparency, and trustworthiness in the cloud industry and joins a competitive list of other recognized leaders. With over 2,000 cloud service providers listed, we’re proud to have our name among the best.So, what does this mean for you? As a Data and AI company, Cognite is dedicated to empowering industries worldwide - from Energy and Process Manufacturing to many other industrial sectors. Our solutions help improve production uptime, optimize operations, and drive innovation. We’re committed to not only delivering cutting-edge technology but also ensuring that your data is handled with the utmost security and care.This reco

11 days ago

Anita HæhreHead of Academy and Community

published in Digitalization Community

Announcing The Cognite Atlas AI™ Definitive Guide to Industrial Agents: Unlock AI’s Full Potential in Your OperationsINDUSTRIAL AGENTS

We’re thrilled to introduce The Cognite Atlas AI™ Definitive Guide to Industrial Agents - a must-have resource for industrial leaders aiming to supercharge their AI-driven digital transformation!Building on the insights from The Definitive Guide to Generative AI for Industry, this new guide goes deeper into how industrial agents can revolutionize operations with AI-powered precision and actionable insights.While generative AI holds incredible potential, its effectiveness in industrial environments often depends on the right context. This guide highlights how industrial agents bring AI and machine learning directly to the unique challenges of your industry, helping you optimize production, improve asset performance, and make smarter, data-driven decisions.Whether you're an operator, engineer, or part of a team focused on safety, efficiency, and innovation, this guide offers practical, actionable insights to accelerate your AI initiatives. Learn how to streamline operations, assess your

290

12 days ago

dalvaniampSeasoned

asked in Developer and User Community

Infield offline with Safari

Hello everyone.I was testing the offline mode on Infield and got an odd behavior using an iPad, with Safari: when I get offline, I am not able to select any field to insert values nor click any buttons. It is only possible when I am back online. Is this how it is supposed to work?I have a video but could not attach here,Thank you in advance.

12 days ago

Page 1 / 40

Generate client secret for OID

Please generate a client secret once every 180 days.

Choose the application:

Badge winners

Bhushan Kumarhas earned the badge Cognite InField Practitioner
Joy Baruahas earned the badge Cognite Data Fusion Fundamentals
Joy Baruahas earned the badge Cognite Domain Expert Basics
Joy Baruahas earned the badge Cognite Data Scientist Basics
Joy Baruahas earned the badge Cognite InField Practitioner

Show all badges

Terms & Conditions Cookie Settings

Sign up

Already have an account? Login

Log in to the community

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.