Product User Community

HelloI want to know if it is possible to implement a loop within a transformation?

I am doing some hands-on exercises, but I am stuck in a point here.The task is to Add some time series data:- Create a time series object for each country asset in CDF called <country>_population and associate it with its corresponding country asset.  Remember to associate the data as well to the data set that you created.   As an example, the time series for Aruba would be called Aruba_population.- Load the data from populations_postprocessed.csv into a pandas dataframe.- Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe.- As a check, retrieve the latest population data for the countries of Latvia, Guatemala, and Benin.- Calculate the total population of the Europe region using the Asset Hierarchy and the time series data.The point I stuck on:=> “Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe”. I am not sure what does this means, although I had done an early exercise …“Insert th

Hi Team, Can you please reset my MFA. My previous phone is damaged and wants to setup MFA on new device. email - rnile@slb.com

Dear developer community,The Cognite product team building the GraphQL API for our Data Modelling API is planning to upgrade third party libraries used in the implementation of the service. This is part of our normal product lifecyle and maintenance, and would not normally be something we make a dedicated announcement of. The upgrade brings improved validation, performance, and other fixes.However we have seen that this upgrade is liable to cause issues for some clients that make GraphQL requests that are not compliant with the GraphQL specification. Specifically, primitive types in field values will no longer be coerced into the correct type by the GraphQL server. So, for example, a client sending the string ”true” where the boolean value true would be correct will, after the upgrade, receive an error rather than the server quietly accepting and converting the value.This behavior change should not be an issue for anyone using one of the compliant third party GraphQL client libraries o

Can we connect Petrel to Cognite and write back from Cognite to Petrel? and how it is done?

Hi Everyone,Have you heard about the Cognite Most Valuable Professional (MVP) Program? If not, it’s time to check it out and see how you can take your community engagement to the next level!Being an MVP is more than just a title. It’s a recognition of your skills, contributions, and leadership within the Cognite ecosystem. Whether you're answering questions, posting topics, sharing ideas, or leveling up your expertise through our comprehensive learning path offering – every step gets you closer to becoming a recognized leader.If you're already contributing, keep up the great work – you're closer to MVP than you think! And if you're just getting started, now is the perfect time to dive in. Check out the full post about our MVP program here to learn more about the program and see how you can start your MVP journey today!Let’s motivate each other, engage more, and climb the leaderboard together. Who will be our next MVP? 🌟

HelloIs it possible to get a list of data sets to then use within a transformation? I can see it is possible with the API and pythonSDK to get a list of data sets.I want to get a list of data sets, then based on certain conditions fetch data from those data sets.

Hi,Do we backup the Cognite function logs as well? If yes, what is the retention period? Can we recover the logs later to see the old activities?  

Hello,  Does Cognite Team have any intention to have a Terraform provider ? :)  Cheers,

Hello! Is it possible to do forward filling of CDF timeseries datapoints at second level? Example: I have a timeseries with values at certain timestamp as the tag is coming only on value change. But I want to forward fill the values to be able to analyze the tags better in PowerBI (this operation takes much time in PowerBI). 

I would like to use variables in a SQL transformations, trying the syntax shown in this StackOverflow article.  However, the following SQL fails with the message “Query is not safe for execution. It must not contain commands like CREATE, DROP, INSERT, etc., but found node: SetCommand.”  How can I use SQL variables with this Spark implementation?SET startDate="2023-01-01"SET endDate="2023-12-31"SELECT explode(sequence(to_timestamp(${startDate}), to_timestamp(${endDate}), interval 12 hours)) AS timestamp

When using Entity Match/Quick Match, the user cannot “Select All” matching Events (or Timeseries) when applying an additional filter. The check box is grayed out. Pretty frustrating. Am I missing something? 

Hello,  We have trouble deploying new container via cdc-toolkit after changing an attribute property. We have the following error:  cognite.client.exceptions.CogniteAPIError: Cannot change type for property ││ 'PullDate' in container 'space:container'. | code: 400 Notes;This container contains data before this change We incremented the model version to a new major one We have consumers consuming the current versionWhat is the best practice for handling this kind of changes with the least effect on our current consumers ?  Thanks,

Hello,  We noticed that we get throttled (429 HTTP responses) on our backend whenever we make more than 10 req/sec. Is this a soft limit? Could we increase it? Thanks

Hello,  Does CDF provide CDC connectors/extractors for common SQL databases ?  Thanks

I have a use case where I need to filter events from CDF based on a “string.contains” pattern. Is this possible with the current API? Consider the following metadata field for an event in CDF. "EventData": "[{"version":"2.0.0"},{"type":"opcae"},{"id":"1d21002a-77a2-4531-a9bf-27f28876f2e1"},{"source":"47-PA-9810B-M01"},{"time":"5/29/2024 8:56:41 AM"},{"eventType":"Simple"},{"eventCategory":3439269159},{"eventCategoryName":"Process Simple Event"},{"severity":404},{"message":"Start"},{"eventCounter":187718259},{"Class":127},{"ObjectDescription":"PH PotWtr Pump B"},{"PriorityLevel":5}]"The value for `EventData` is a JSON string that has not been unpacked as proper metadata fields. Several of these fields are relevant for us to filter events down to the relevant subset.It is unclear from the documentation whether the API supports the “string.contains” pattern. The only class that maybe sounds like it is relevant is the Search class. This is the documentation:SearchThe Search filter perform

The PI AF Extractor is missing link to the documentation, is there someone that could add this in.For the PI extractor the links are there and something similar for the PI AF extractor would make it easy to navigate to the documentation. The PI AF looks like this:The documentation does exist and lies under this area, would be great if we could navigate from CDF directly to the documentation.https://docs.cognite.com/cdf/integration/guides/extraction/pi_af Regards,Markus PettersenAker BP - CDF Data Delivery

Hi all, I am encountering an issue when calling the client.iam.groups.list(all=True) method in my Python 3.12 environment within Azure Batch. The code runs without issues in my local setup (also Python 3.12), but it fails in Azure Batch with the following traceback: Traceback (most recent call last): File "GroupMembersCapabilities.py", line 55, in <module> groups = client.iam.groups.list(all=True) File "D:\Users\...\site-packages\cognite\client\_api\iam.py", line 297, in list return GroupList._load(res.json()["items"], cognite_client=self._cognite_client, allow_unknown=True) File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 224, in _load [cls._RESOURCE._load(res, cognite_client, allow_unknown) for res in resource_list] File "D:\Users\...\site-packages\cognite\client\data_classes\iam.py", line 147, in _load capabilities=[Capability.load(c, allow_unknown) for c in resource.get("capabilities", [])] or None File "D:\Users\...\site-packages\cognite\client\data

Hi,I’ve set up notification alerts for the extraction pipeline for two projects (dev and prod). However, the notifications I’m receiving don’t indicate whether they are from the dev or prod environment—they’re quite generic. Could you please advise if there’s a way to enhance the messages to include project-specific details?Thank you!  

I no longer see the Events button on the Chart UI. But I do see events previously configured. Please help. 

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

Hi Cognite Community! I'm Henry Martinez, Head of Products, Operations data  in SLB.I’m thrilled to announce that I’ll be speaking at Cognite’s Impact user conference, where I’ll be diving deep into how Cognite Hub has played a pivotal role in advancing the SLB and Cognite partnership. We’ve seen firsthand how the Hub has streamlined internal processes, enhanced user onboarding, and boosted product engagement. With nearly 7000 active members, the Hub has become a go-to place for expert advice, industry discussions, and knowledge sharing.Here are some key highlights I’ll cover at Impact:How the Hub’s collaborative environment fosters innovation and strengthens partnerships Ways to make the most of dedicated feature groups for early adopters, gaining access to beta features and expert support Leveraging event calendars, submitting product ideas, and voting on existing ones to actively shape the future of our productWhether you're attending the conference or engaging here in the community

Hello,I am trying to set up a database extractor for SQL Server database. I would like to pass parameters to the query so that the extraction logic can be controlled via the env file. Here is what I have done.Created an environment variable called “DEPT_ID”, In the YAML file, I am using ${DEPT_ID} to use the value of the env variable.  SELECT *FROM [Employee] WHERE [Dept_id] = ${DEPT_ID} While running the DB-Extractor, I am encountering the following error.KeyError: DEPT_ID I am wondering if the product even supports the use of parameterized queries in the DB-Extractor.Any help will be greatly appreciated.  Thanks,Dinesh

I am just playing with the analysis of open industrial data (mostly time series IoT sensor data). It is my understanding that encoders play a role in detecting anomalies in the data. Can decoder only models such as Lag-Llama, TimesFM, Moirai detect anomalies or they can only predict? thank you.