Community Discussions

Hello,  We noticed that we get throttled (429 HTTP responses) on our backend whenever we make more than 10 req/sec. Is this a soft limit? Could we increase it? Thanks

Hello,  Does CDF provide CDC connectors/extractors for common SQL databases ?  Thanks

I have a use case where I need to filter events from CDF based on a “string.contains” pattern. Is this possible with the current API? Consider the following metadata field for an event in CDF. "EventData": "[{"version":"2.0.0"},{"type":"opcae"},{"id":"1d21002a-77a2-4531-a9bf-27f28876f2e1"},{"source":"47-PA-9810B-M01"},{"time":"5/29/2024 8:56:41 AM"},{"eventType":"Simple"},{"eventCategory":3439269159},{"eventCategoryName":"Process Simple Event"},{"severity":404},{"message":"Start"},{"eventCounter":187718259},{"Class":127},{"ObjectDescription":"PH PotWtr Pump B"},{"PriorityLevel":5}]"The value for `EventData` is a JSON string that has not been unpacked as proper metadata fields. Several of these fields are relevant for us to filter events down to the relevant subset.It is unclear from the documentation whether the API supports the “string.contains” pattern. The only class that maybe sounds like it is relevant is the Search class. This is the documentation:SearchThe Search filter perform

The PI AF Extractor is missing link to the documentation, is there someone that could add this in.For the PI extractor the links are there and something similar for the PI AF extractor would make it easy to navigate to the documentation. The PI AF looks like this:The documentation does exist and lies under this area, would be great if we could navigate from CDF directly to the documentation.https://docs.cognite.com/cdf/integration/guides/extraction/pi_af Regards,Markus PettersenAker BP - CDF Data Delivery

Hi all, I am encountering an issue when calling the client.iam.groups.list(all=True) method in my Python 3.12 environment within Azure Batch. The code runs without issues in my local setup (also Python 3.12), but it fails in Azure Batch with the following traceback: Traceback (most recent call last): File "GroupMembersCapabilities.py", line 55, in <module> groups = client.iam.groups.list(all=True) File "D:\Users\...\site-packages\cognite\client\_api\iam.py", line 297, in list return GroupList._load(res.json()["items"], cognite_client=self._cognite_client, allow_unknown=True) File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 224, in _load [cls._RESOURCE._load(res, cognite_client, allow_unknown) for res in resource_list] File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 147, in _load capabilities=[Capability.load(c, allow_unknown) for c in resource.get("capabilities", [])] or None File "D:\Users\...\site-packages\cognite\client\data

Hi,I’ve set up notification alerts for the extraction pipeline for two projects (dev and prod). However, the notifications I’m receiving don’t indicate whether they are from the dev or prod environment—they’re quite generic. Could you please advise if there’s a way to enhance the messages to include project-specific details?Thank you!  

How can I read vibration data in the Open Industrial Dataset? I have tried different options (GUI, via SDK) the response is blank (i.e., no data). Is there any trick or any particular setting for reading vibration data? thank you very much.

I no longer see the Events button on the Chart UI. But I do see events previously configured. Please help. 

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable.  SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated.  Thanks,Dinesh

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.

Hello team, I am bulding an application using the methods in cognite python sdk.I want to create dropdowns for metadata and the values for the same. This similar to the filters on the data explorer screen in the fusion UI:I could not find a direct SDK method to do so.Could you please guide me on how can I achieve that?

I have got postman connected to the publicdata project using the details below:Environmenttenant-id: 48d5043c-cf70-4c49-881c-c638f5796997 baseUrl: https://api.cognitedata.com project: publicdata cluster: apiAuth token:callbackUrl: https://postman.cogniteapp.com/loggedin authUrl: https://login.microsoftonline.com/{{tenant-id}}/oauth2/v2.0/authorize clientId: https://postman.cogniteapp.com Scope: https://{{cluster}}.cognitedata.com/.defaultI sign in with the credentials I used to sign up in the Cognite Academy, which I understand means they are added to the Azure AD for the publicdata project.I can access some of the api endpoints via Postman so the authentication is working but I get a 403 unauthorised when I try to list all Assets. Am I meant to be able to see the assets in Postman with this setup? Thanks in advance, Andy

I want to visualize some data from the API directly in Power BI. For instance, I want to display data about extraction pipelines https://api-docs.cognite.com/20230101/tag/Extraction-Pipelines/operation/listExtPipes. How can I use the CDF API as a data source in Power BI and input my credentials there in the correct way? Thank you! 

Across multiple javascript projects, we use the @cognite/sdk. We observe some strange behaviour when it comes to authentication and see the Chrome network panel full of HTTP 401 calls. When debugging the issue, we see that the getToken method supplied to the CogniteClient class only gets called some times. And when it does, the code on our part successfully retrieves a valid token. This leads to some unwanted behaviour and the user sometimes needs to refresh the browser in order to correct the browser state.I suspect the fact that we make a new instance of CogniteClient everytime we use it could be the culprit. I read from the source code baseCogniteClient.ts that the getToken function is not called each time in order to “To prevent calling `getToken` method multiple times in parallel”. Not that I am really able to follow this behaviour over multiple instances of the client.Any pointers as to what might cause this problem?const getToken = async () => {  // this code only hits some t

Hello Cognite experts, I trying to find our some reference material to explore regarding integrating data from RTSP in Cognite. Are there any workflows/POC/documentation/examples available for this data source? 

Hello,Is it possible to host a pickle file (which contains a ML model) in CDF and use it to make predictions for the available data in the platform?If yes, what are the steps ? I browsed the documentation but I haven’t found anything relevant

Hi,I am running parallel tasks(Cognite functions) in Cognite workflows. One of the task is creating table in Raw db, where as other one is deleting the table. Whatever table is create, its name is passed as input to other function deleting it.First attempt I ran 150 parallel tasks in a 10 workflows(each 15 tasks). One table was not deleted from raw db  In second attempt I ran 200 parallel task in 10 workflows(each 20 tasks). In this case 8 tables were not deleted from rawI was not able to debug why those table not get deleted. As the delete function status was showing ‘Completed’ on Cognite UI.Can you please help why this tables are not getting deleted? If there is a limit of parallel task execution then how to exceed this limit? And how to debug this scenario where there is no function execution failure?Attaching the test workflow for reference. Run workflow-deploy-job.py file to deploy workflow on cognite project. Edit functions.json and workflow-deploy-job.py files for replacing cog

Hey Guys, I would like to know when will be possible download the Canvas Page.

Ingesting data through OPCUA where the OPCUA Server timezone is set as UTC+8.After ingestion, the timeseries somehow normalize the data to UTC+0.E.g. Ingesting data at 2024-09-11 11:00+08:00But checked the timeseries data as 2024-09-11 11:00+00:00 which mean 2024-09-11 19:00+08:00.How do we ensure that the ingested data uses the correct timezone when storing it?

Hey.I am trying to set up a monitoring job in Cognite Charts, with notifications sent to an Microsoft Teams Channel Email. It looks like the email would not be recognized as an valid email.I got this error: “You should select a user or write a valid email address”The email format is xxxx..onmicrosoft.com@emea.teams.ms Any suggestions on how to resolve this?

Can someone tell me about this. if i Want to keep OPC UA realtime data into cdf RAW using opc ua extractor?

Hello I was having the Authenticator setup for logging to zendesk and other cognite sites. But somehow its not there on my mobile now. can you help with re-registering ?my id - nbhatewara@slb.com Neeraj B

2 Questions:What is the user limit for the number of Industrial Canvas pages they can create?Can we auto-delete Canvas pages after some time [Ex: 3 days] to avoid overpopulating the Canvas page/data?

Hello everyone.I was testing the offline mode on Infield and got an odd behavior using an iPad, with Safari: when I get offline, I am not able to select any field to insert values nor click any buttons. It is only possible when I am back online.  Is this how it is supposed to work?I have a video but could not attach here,Thank you in advance.