Skip to main content

Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 904 Topics
  • 2,938 Replies
904 Topics
M
Seasoned
Marwen TALEBSeasoned
asked in Developer and User Community
Cognite Terraform provider?

Hello,  Does Cognite Team have any intention to have a Terraform provider ? :)  Cheers,

211
Andre Alves
MVP
2 months ago
R
Seasoned
Raluca BalaSeasoned
asked in Developer and User Community
Forward fill CDF timeseries datapoints

Hello! Is it possible to do forward filling of CDF timeseries datapoints at second level? Example: I have a timeseries with values at certain timestamp as the tag is coming only on value change. But I want to forward fill the values to be able to analyze the tags better in PowerBI (this operation takes much time in PowerBI). 

393
Mithila Jayalath
Seasoned Practitioner
2 months ago
Glen Accardo
Active
Glen AccardoActive
asked in Developer and User Community
Using SQL Variables in Transformations

I would like to use variables in a SQL transformations, trying the syntax shown in this StackOverflow article.  However, the following SQL fails with the message “Query is not safe for execution. It must not contain commands like CREATE, DROP, INSERT, etc., but found node: SetCommand.”  How can I use SQL variables with this Spark implementation?SET startDate="2023-01-01"SET endDate="2023-12-31"SELECT explode(sequence(to_timestamp(${startDate}), to_timestamp(${endDate}), interval 12 hours)) AS timestamp

1154
D
Committed
2 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community
Entity Matching Select All when using filters

When using Entity Match/Quick Match, the user cannot “Select All” matching Events (or Timeseries) when applying an additional filter. The check box is grayed out. Pretty frustrating. Am I missing something? 

656
Mithila Jayalath
Seasoned Practitioner
2 months ago
M
Seasoned
Marwen TALEBSeasoned
asked in Developer and User Community
Changing attribute type in a container definition in CDF Data model

Hello,  We have trouble deploying new container via cdc-toolkit after changing an attribute property. We have the following error:  cognite.client.exceptions.CogniteAPIError: Cannot change type for property ││ 'PullDate' in container 'space:container'. | code: 400 Notes;This container contains data before this change We incremented the model version to a new major one We have consumers consuming the current versionWhat is the best practice for handling this kind of changes with the least effect on our current consumers ?  Thanks,

442
AndersM
Seasoned Practitioner
2 months ago
M
Seasoned
Marwen TALEBSeasoned
asked in Developer and User Community
Is it possible to raise req/sec rate to CDF?

Hello,  We noticed that we get throttled (429 HTTP responses) on our backend whenever we make more than 10 req/sec. Is this a soft limit? Could we increase it? Thanks

705
Glen Sykes
Seasoned Practitioner
2 months ago
M
Seasoned
Marwen TALEBSeasoned
asked in Developer and User Community
CDC extractors

Hello,  Does CDF provide CDC connectors/extractors for common SQL databases ?  Thanks

423
Andre Alves
MVP
2 months ago
Anders Brakestad
Seasoned
Anders BrakestadSeasoned
asked in Developer and User Community
Is it possible to filter events with string matching ("string.contains")?

I have a use case where I need to filter events from CDF based on a “string.contains” pattern. Is this possible with the current API? Consider the following metadata field for an event in CDF. "EventData": "[{"version":"2.0.0"},{"type":"opcae"},{"id":"1d21002a-77a2-4531-a9bf-27f28876f2e1"},{"source":"47-PA-9810B-M01"},{"time":"5/29/2024 8:56:41 AM"},{"eventType":"Simple"},{"eventCategory":3439269159},{"eventCategoryName":"Process Simple Event"},{"severity":404},{"message":"Start"},{"eventCounter":187718259},{"Class":127},{"ObjectDescription":"PH PotWtr Pump B"},{"PriorityLevel":5}]"The value for `EventData` is a JSON string that has not been unpacked as proper metadata fields. Several of these fields are relevant for us to filter events down to the relevant subset.It is unclear from the documentation whether the API supports the “string.contains” pattern. The only class that maybe sounds like it is relevant is the Search class. This is the documentation:SearchThe Search filter perform

262
Glen Sykes
Seasoned Practitioner
2 months ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreHead of Academy and Community
published in Developer and User Community
Submit Your Success Story and Earn a Free Ticket to IMPACT 2024 (Worth $1,450!)User Conference

Hi Community!We’d love to hear your stories! Share how Cognite’s products or services have transformed your work, and in return, and you could earn a free ticket to IMPACT 2024, our User Conference. Please note that seats are limited and will be allocated on a first-come, first-served basis. Participants are kindly asked to cover their own travel and accommodation expenses. How to Participate?Share a success story in our community where Cognite played a key role – whether it improved workflows, solved complex problems, or boosted productivity Highlight the tools or services you used and the specific impact they had on your projects or organizationWhy Submit Your Story?Earn a complimentary ticket to IMPACT 2024, valued at $1,450! Gain visibility within the global Cognite community Inspire others facing similar challenges with your innovationWe encourage you to seize this amazing opportunity - we’d love to hear from you! 🚀 

350
Anita Hæhre
Seasoned Practitioner
2 months ago
M
Committed
Markus PettersenCommitted
asked in Developer and User Community
Extractor missing link to documentation

The PI AF Extractor is missing link to the documentation, is there someone that could add this in.For the PI extractor the links are there and something similar for the PI AF extractor would make it easy to navigate to the documentation. The PI AF looks like this:The documentation does exist and lies under this area, would be great if we could navigate from CDF directly to the documentation.https://docs.cognite.com/cdf/integration/guides/extraction/pi_af Regards,Markus PettersenAker BP - CDF Data Delivery

141
Isha Thapliyal
Seasoned Practitioner
2 months ago
zgchina
Committed
zgchina
asked in Developer and User Community
Issue with client.iam.groups.list() in Python 3.12 (TypeError in Enum Action)

Hi all, I am encountering an issue when calling the client.iam.groups.list(all=True) method in my Python 3.12 environment within Azure Batch. The code runs without issues in my local setup (also Python 3.12), but it fails in Azure Batch with the following traceback: Traceback (most recent call last): File "GroupMembersCapabilities.py", line 55, in <module> groups = client.iam.groups.list(all=True) File "D:\Users\...\site-packages\cognite\client\_api\iam.py", line 297, in list return GroupList._load(res.json()["items"], cognite_client=self._cognite_client, allow_unknown=True) File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 224, in _load [cls._RESOURCE._load(res, cognite_client, allow_unknown) for res in resource_list] File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 147, in _load capabilities=[Capability.load(c, allow_unknown) for c in resource.get("capabilities", [])] or None File "D:\Users\...\site-packages\cognite\client\data

302
Isha Thapliyal
Seasoned Practitioner
2 months ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community
Events Button missing from Chart UI

I no longer see the Events button on the Chart UI. But I do see events previously configured. Please help. 

677
kelvin
Seasoned Practitioner
2 months ago
Pablo Palacios
Seasoned
Pablo PalaciosSeasoned
asked in Developer and User Community
Excel Extractor

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

8710
Pablo Palacios
Seasoned
2 months ago
Henry Martinez
MVP
Henry MartinezMVP
published in Developer and User Community
Join me at Impact 2024: Exploring the key to SLB’s success in innovation and collaboration!

Hi Cognite Community! I'm Henry Martinez, Head of Products, Operations data  in SLB.I’m thrilled to announce that I’ll be speaking at Cognite’s Impact user conference, where I’ll be diving deep into how Cognite Hub has played a pivotal role in advancing the SLB and Cognite partnership. We’ve seen firsthand how the Hub has streamlined internal processes, enhanced user onboarding, and boosted product engagement. With nearly 7000 active members, the Hub has become a go-to place for expert advice, industry discussions, and knowledge sharing.Here are some key highlights I’ll cover at Impact:How the Hub’s collaborative environment fosters innovation and strengthens partnerships Ways to make the most of dedicated feature groups for early adopters, gaining access to beta features and expert support Leveraging event calendars, submitting product ideas, and voting on existing ones to actively shape the future of our productWhether you're attending the conference or engaging here in the community

924
Henry Martinez
MVP
2 months ago
dinesh.makked
Seasoned
dinesh.makkedSeasoned
asked in Developer and User Community
How to use parameterized query in the DB-Extractor?

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable.  SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated.  Thanks,Dinesh

402
P
Practitioner
2 months ago
S
Committed
sridiyerCommitted
asked in Developer and User Community
Decoder only time series models like TimesFM (google), Lag-Llama, Moirai

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.

584
S
Committed
2 months ago
G
Committed
Gargi BhosaleCommitted
asked in Developer and User Community
how to retrieve metadata key value pairs using python sdk

Hello team, I am bulding an application using the methods in cognite python sdk.I want to create dropdowns for metadata and the values for the same. This similar to the filters on the data explorer screen in the fusion UI:I could not find a direct SDK method to do so.Could you please guide me on how can I achieve that?

467
Isha Thapliyal
Seasoned Practitioner
2 months ago
P
Practitioner
Patrick MishimaProduct Specialist
posted in Developer and User Community
Azure with Cognite Data Fusion - Data Integration Part 1

Hello All! As this is my first time writing, I will do a quick introduction. My name is Patrick Mishima, and I am one of the Cognite Product Specialists. My main specialization is data integration and governance. I've worked with data since 2011 with different roles, projects, and job titles all related to data management. I also have experience with various ETL and BI tools, mainly from Microsoft and SAP and a few others.I lead the Product Specialists team, and we'll soon have more articles to share our knowledge and experience with you.Today and in my following articles, I will focus on the different options that Microsoft Azure and Cognite offer on data integration between our platforms and tools. But first, let's talk about a few essential and fundamental points when working with cloud providers. Using a cloud provider, most of the time, we think about saving on infrastructure costs. That is indeed true, but it's not the only truth. When you decide to move to a cloud provider, you

4391
R
Seasoned
2 months ago
S
Committed
sebastianheibo.aksoCommitted
asked in Developer and User Community
Connecting to CDF API in Power BI

I want to visualize some data from the API directly in Power BI. For instance, I want to display data about extraction pipelines https://api-docs.cognite.com/20230101/tag/Extraction-Pipelines/operation/listExtPipes. How can I use the CDF API as a data source in Power BI and input my credentials there in the correct way? Thank you! 

273
Everton Colling
Seasoned Practitioner
2 months ago
A
Committed
Anders NygaardCommitted
asked in Developer and User Community
Javascript SDK: getToken runs only some of the time when using CogniteClient

Across multiple javascript projects, we use the @cognite/sdk. We observe some strange behaviour when it comes to authentication and see the Chrome network panel full of HTTP 401 calls. When debugging the issue, we see that the getToken method supplied to the CogniteClient class only gets called some times. And when it does, the code on our part successfully retrieves a valid token. This leads to some unwanted behaviour and the user sometimes needs to refresh the browser in order to correct the browser state.I suspect the fact that we make a new instance of CogniteClient everytime we use it could be the culprit. I read from the source code baseCogniteClient.ts that the getToken function is not called each time in order to “To prevent calling `getToken` method multiple times in parallel”. Not that I am really able to follow this behaviour over multiple instances of the client.Any pointers as to what might cause this problem?const getToken = async () => {  // this code only hits some t

471
BugGambit
Practitioner
2 months ago