Product User Community

Hi all, I am encountering an issue when calling the client.iam.groups.list(all=True) method in my Python 3.12 environment within Azure Batch. The code runs without issues in my local setup (also Python 3.12), but it fails in Azure Batch with the following traceback: Traceback (most recent call last): File "GroupMembersCapabilities.py", line 55, in <module> groups = client.iam.groups.list(all=True) File "D:\Users\...\site-packages\cognite\client\_api\iam.py", line 297, in list return GroupList._load(res.json()["items"], cognite_client=self._cognite_client, allow_unknown=True) File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 224, in _load [cls._RESOURCE._load(res, cognite_client, allow_unknown) for res in resource_list] File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 147, in _load capabilities=[Capability.load(c, allow_unknown) for c in resource.get("capabilities", [])] or None File "D:\Users\...\site-packages\cognite\client\data

Hi,I’ve set up notification alerts for the extraction pipeline for two projects (dev and prod). However, the notifications I’m receiving don’t indicate whether they are from the dev or prod environment—they’re quite generic. Could you please advise if there’s a way to enhance the messages to include project-specific details?Thank you!  

I no longer see the Events button on the Chart UI. But I do see events previously configured. Please help. 

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

Hi Cognite Community! I'm Henry Martinez, Head of Products, Operations data  in SLB.I’m thrilled to announce that I’ll be speaking at Cognite’s Impact user conference, where I’ll be diving deep into how Cognite Hub has played a pivotal role in advancing the SLB and Cognite partnership. We’ve seen firsthand how the Hub has streamlined internal processes, enhanced user onboarding, and boosted product engagement. With nearly 7000 active members, the Hub has become a go-to place for expert advice, industry discussions, and knowledge sharing.Here are some key highlights I’ll cover at Impact:How the Hub’s collaborative environment fosters innovation and strengthens partnerships Ways to make the most of dedicated feature groups for early adopters, gaining access to beta features and expert support Leveraging event calendars, submitting product ideas, and voting on existing ones to actively shape the future of our productWhether you're attending the conference or engaging here in the community

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable.  SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated.  Thanks,Dinesh

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.

Hello team, I am bulding an application using the methods in cognite python sdk.I want to create dropdowns for metadata and the values for the same. This similar to the filters on the data explorer screen in the fusion UI:I could not find a direct SDK method to do so.Could you please guide me on how can I achieve that?

Hello All! As this is my first time writing, I will do a quick introduction. My name is Patrick Mishima, and I am one of the Cognite Product Specialists. My main specialization is data integration and governance. I've worked with data since 2011 with different roles, projects, and job titles all related to data management. I also have experience with various ETL and BI tools, mainly from Microsoft and SAP and a few others.I lead the Product Specialists team, and we'll soon have more articles to share our knowledge and experience with you.Today and in my following articles, I will focus on the different options that Microsoft Azure and Cognite offer on data integration between our platforms and tools. But first, let's talk about a few essential and fundamental points when working with cloud providers. Using a cloud provider, most of the time, we think about saving on infrastructure costs. That is indeed true, but it's not the only truth. When you decide to move to a cloud provider, you

I want to visualize some data from the API directly in Power BI. For instance, I want to display data about extraction pipelines https://api-docs.cognite.com/20230101/tag/Extraction-Pipelines/operation/listExtPipes. How can I use the CDF API as a data source in Power BI and input my credentials there in the correct way? Thank you! 

Hello,I am trying to understand the difference between Sequences and Events to see what is pertinent for me in a specific use case. For me, both of them allow saving a native CDF object along with a timestamp, enriched with other data. I feel like we can also achieve the same goal by making a data model with timestamps in one column and all the properties we are interested in, in other columns;  though this approach would be harder because it would necessitate using pygen for input output. In my company, we work on Industrial processing lines. At any given moment, a line is operating under a set of conditions, defined by a fixed set of set points, like ‘conveyor speed’ and various temperatures. Let us call the set points a, b, c etc. For set points a, b and c, we have measured values i, j and k.To assess whether the machine is operating normally, we want to compare the aggregated measurements (i-j-k) taken during a period when the set points are a-b-c with a previous instance when the

Hello Cognite experts, I trying to find our some reference material to explore regarding integrating data from RTSP in Cognite. Are there any workflows/POC/documentation/examples available for this data source? 

Hello,Is it possible to host a pickle file (which contains a ML model) in CDF and use it to make predictions for the available data in the platform?If yes, what are the steps ? I browsed the documentation but I haven’t found anything relevant

In some AI demos built on top of Cognite, our approach to real-time inference involves retrieving the latest time series values for the equipment. Since our machine learning models are deployed and running on a cluster outside Cognite, we leverage the SDK to handle real-time inference by retrieving the most recent data as follows:real_time_data_bomb_hfx = cdf_client.time_series.retrieve_latest(id="bomt_hfx_time_series_id")Is anyone working with a different approach to send new data for inference to their machine learning models? I'd be interested in hearing how others are managing this process.We are also exploring more resilient approaches, such as: Streaming Data for Real-Time Inference (Event-Driven Approach): We plan to test Cognite's Kafka extractor as soon as possible to enable more seamless streaming. On-Demand Inference via API: While this approach is synchronous, which has caused challenges for us in the past, we prefer to avoid this method and lean toward more asynchronous

I am making comparisons between time series data in CDF and PI. The reason is that in our tenants the CDF data is not 100% accurate compared to PI.However, from my testing I think that PI performs its aggregations with the timestamps “centered” at the aggregated time periods, while CDF puts the timestamps at the start of each aggregated period. Is it possible to specify how this is done with the Python API? From my study of the docs it appears not to be the case. The same applies to the PI Web API as well: I cannot specify how the timestamps are placed. The agreement with PI becomes significantly better if I place the CDF timestamps at the center of the aggregated time periods.My current workaround is the following:Fetch RAW data from CDF Shift the timestamps by 0.5x of the granularity Resample to the desired granularity Compute mean Interplate any missing valuesThe issue is that fetching raw data is a lot more time consuming than fetching aggregates. I have been playing with fetching

Hi,I am running parallel tasks(Cognite functions) in Cognite workflows. One of the task is creating table in Raw db, where as other one is deleting the table. Whatever table is create, its name is passed as input to other function deleting it.First attempt I ran 150 parallel tasks in a 10 workflows(each 15 tasks). One table was not deleted from raw db  In second attempt I ran 200 parallel task in 10 workflows(each 20 tasks). In this case 8 tables were not deleted from rawI was not able to debug why those table not get deleted. As the delete function status was showing ‘Completed’ on Cognite UI.Can you please help why this tables are not getting deleted? If there is a limit of parallel task execution then how to exceed this limit? And how to debug this scenario where there is no function execution failure?Attaching the test workflow for reference. Run workflow-deploy-job.py file to deploy workflow on cognite project. Edit functions.json and workflow-deploy-job.py files for replacing cog

Hey Guys, I would like to know when will be possible download the Canvas Page.

Ingesting data through OPCUA where the OPCUA Server timezone is set as UTC+8.After ingestion, the timeseries somehow normalize the data to UTC+0.E.g. Ingesting data at 2024-09-11 11:00+08:00But checked the timeseries data as 2024-09-11 11:00+00:00 which mean 2024-09-11 19:00+08:00.How do we ensure that the ingested data uses the correct timezone when storing it?

Hi all.We’re working on defining KPIs to track our digitalization journey, and think that a KPI on the use and adoption of CDF as opposed to “the old way of doing things” would be useful. I’m posting here in an attempt to hear if the CDF customer community can provide inspiration for how to ensure success and good adoption of CDF among users. Does anyone have thoughts to share on their own metrics for CDF usage?My thoughts so far are tracking the number of unique users logging in to Fusion/Charts, number of API calls against CDF, etc. Although I have not found any direct way as a customer to obtain this information. The Sessions API endpoint could possibly be a place to start?And as a follow-up question; CDF usage in itself is a quite indirect metric on the digital maturity of the business, and on acheived value. My ideal goal would be to find a more direct higher level metric for the entire company, which is not as indirect as user log-ins, and also not as narrow as value obtained for

Hey.I am trying to set up a monitoring job in Cognite Charts, with notifications sent to an Microsoft Teams Channel Email. It looks like the email would not be recognized as an valid email.I got this error: “You should select a user or write a valid email address”The email format is xxxx..onmicrosoft.com@emea.teams.ms Any suggestions on how to resolve this?

Can someone tell me about this. if i Want to keep OPC UA realtime data into cdf RAW using opc ua extractor?

Hello I was having the Authenticator setup for logging to zendesk and other cognite sites. But somehow its not there on my mobile now. can you help with re-registering ?my id - nbhatewara@slb.com Neeraj B

2 Questions:What is the user limit for the number of Industrial Canvas pages they can create?Can we auto-delete Canvas pages after some time [Ex: 3 days] to avoid overpopulating the Canvas page/data?

We’re excited to announce that Cognite is now officially listed on the CSA STAR Registry at Level 1! 🌟Cloud Security Alliance (CSA) STAR Registry is a trusted benchmark in cloud security, providing a comprehensive view of the security practices of cloud service providers. Being included in this registry means that Cognite meets the highest standards of security, transparency, and trustworthiness in the cloud industry and joins a competitive list of other recognized leaders. With over 2,000 cloud service providers listed, we’re proud to have our name among the best.So, what does this mean for you? As a Data and AI company, Cognite is dedicated to empowering industries worldwide - from Energy and Process Manufacturing to many other industrial sectors. Our solutions help improve production uptime, optimize operations, and drive innovation. We’re committed to not only delivering cutting-edge technology but also ensuring that your data is handled with the utmost security and care.This reco