Community Discussions

dear all I was attempting to perform data aggregation based on the date. I am retrieving online data into CDF, which is updated every 2-3 minutes. I am trying to aggregate the data so that the date is updated every 24 hours instead of every 2-4 minutes.I used this code to obtain the list of columns in my data frame.# Check the structure of the DataFrame, including column names and the first few rowsprint(dp.columns)  # This will show all column namesdp.head()          # This will show the first few rows of the DataFrame however, I got only this after running the code I tried to use another code again the first column is not date column. 

HiSince the release of nested workflows I have been looking at suitable use cases for it in our environment. I have sketched up some possible flows, but there are some cases I don`t know how to handle in the best way.Consider this scenario where we have two source systems (source X and Y) where each system has a source model that is populated via transformations. The transformations are divided into multiple workflows based on what project it gets data from. I have two solution models (model 1 and 2) that gets data from the source systems. Model 2 gets data from both source models, while model 1 only gets data from source X. My issue is that the data from the source systems are ingested into CDF raw tables once every morning and the data arrive at different times. If data from source X is in CDF before data from source Y, I want the workflow tasks relevant to solution model 1 to run, but not solution model 2, because the source Y data is not ready yet, however i

Hi Team,Please help me to find the mistakes in my code. Let me showcase the dummy codemain code:def main() -> None:    """    Main entrypoint    """    BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))    config_values_vault.set_vara()    with Extractor(        name="SAP_Extractor",        description="An extractor to extract asset hierarchy from SAP based on root node",        config_class=SapConfig,        # version=__version__,        # debugger        version="1.0.0",        run_handle=run,        metrics=metrics,        config_file_path= os.path.join(BASE_DIR, 'config.yaml'),    ) as extractor:        extractor.run() I have build code unittest for above code: def test_main():    with patch('os.path') as path_mock:

Hi, I would like to get more information regarding the Cognite 3D & Scene module. I have tried building the scene and added 3D model and object but facing some blocker to proceed. Below are my question and hope someone able to help to answer it.Question:How to upload & publish 3D model using SDK or API? How to add 3D model to the Sceme using SDK or API? In CDF UI, only one 3D object instance allow to be added in the scene? Is there a way to have multiple instance of the same 3D object in one scene? 

Recently the user interface in Charts has changed. I’m not seeing the ability to add timeseries via a PID in a contextualized PDF file. See the image below. Is that capability not available any more?You can see the PDF from the Industrial Canvas UI: 

The date field “Last updated” and “Created time” when viewing files linked to assets does not reflect any information I find in the file itself. Where do these fields originate. 2017 is long before our CDF instance was created so it is a bit strange.These are the datetimes from the file header:{ "name": "SKA-AK-ER300-P-XB-0003-001.pdf", "sourceModifiedTime": 2021-01-25 01:30:44, "uploadedTime": 2024-10-02 06:07:37, "createdTime": 2024-05-01 02:46:45, "lastUpdatedTime": 2024-10-11 09:00:04, "uploaded": true} 

HelloI want to know if it is possible to implement a loop within a transformation?

I am doing some hands-on exercises, but I am stuck in a point here.The task is to Add some time series data:- Create a time series object for each country asset in CDF called <country>_population and associate it with its corresponding country asset.  Remember to associate the data as well to the data set that you created.   As an example, the time series for Aruba would be called Aruba_population.- Load the data from populations_postprocessed.csv into a pandas dataframe.- Insert the data for each country in this dataframe using client.time_series.data.insert_dataframe.- As a check, retrieve the latest population data for the countries of Latvia, Guatemala, and Benin.- Calculate the total population of the Europe region using the Asset Hierarchy and the time series data.The point I stuck on:=> “Insert the data for each coun

Hi Team, Can you please reset my MFA. My previous phone is damaged and wants to setup MFA on new device. email - rnile@slb.com

Dear developer community,The Cognite product team building the GraphQL API for our Data Modelling API is planning to upgrade third party libraries used in the implementation of the service. This is part of our normal product lifecyle and maintenance, and would not normally be something we make a dedicated announcement of. The upgrade brings improved validation, performance, and other fixes.However we have seen that this upgrade is liable to cause issues for some clients that make GraphQL requests that are not compliant with the GraphQL specification. Specifically, primitive types in field values will no longer be coerced into the correct type by the GraphQL server. So, for example, a client sending the string ”true” where the boolean value true would be correct will, after the upgrade, receive an error rather than the server quietly accepting and converting the value.This behavior change should not be an issue for anyone using one of th

Can we connect Petrel to Cognite and write back from Cognite to Petrel? and how it is done?

Hi Everyone,Have you heard about the Cognite Most Valuable Professional (MVP) Program? If not, it’s time to check it out and see how you can take your community engagement to the next level!Being an MVP is more than just a title. It’s a recognition of your skills, contributions, and leadership within the Cognite ecosystem. Whether you're answering questions, posting topics, sharing ideas, or leveling up your expertise through our comprehensive learning path offering – every step gets you closer to becoming a recognized leader.If you're already contributing, keep up the great work – you're closer to MVP than you think! And if you're

HelloIs it possible to get a list of data sets to then use within a transformation? I can see it is possible with the API and pythonSDK to get a list of data sets.I want to get a list of data sets, then based on certain conditions fetch data from those data sets.

Hi,Do we backup the Cognite function logs as well? If yes, what is the retention period? Can we recover the logs later to see the old activities?  

Hello,  Does Cognite Team have any intention to have a Terraform provider ? :)  Cheers,

Hello! Is it possible to do forward filling of CDF timeseries datapoints at second level? Example: I have a timeseries with values at certain timestamp as the tag is coming only on value change. But I want to forward fill the values to be able to analyze the tags better in PowerBI (this operation takes much time in PowerBI). 

I would like to use variables in a SQL transformations, trying the syntax shown in this StackOverflow article.  However, the following SQL fails with the message “Query is not safe for execution. It must not contain commands like CREATE, DROP, INSERT, etc., but found node: SetCommand.”  How can I use SQL variables with this Spark implementation?SET startDate="2023-01-01"SET endDate="2023-12-31"SELECT explode(sequence(to_timestamp(${startDate}), to_timestamp(${endDate}), interval 12 hours)) AS timestamp

Recently came across articles on MAD and several variations of ESD test for detecting local vs. global anomalies (outliers) in time series data. Anyone has any experiences with such algorithms and any words of wisdom on how to utilize such algorithms to detect local anomalies? Thank you very much,Is there any benefit other than MAD being more robust (to outliers) than Standard Deviation? what about ESD?

When using Entity Match/Quick Match, the user cannot “Select All” matching Events (or Timeseries) when applying an additional filter. The check box is grayed out. Pretty frustrating. Am I missing something? 

Hello,  We have trouble deploying new container via cdc-toolkit after changing an attribute property. We have the following error:  cognite.client.exceptions.CogniteAPIError: Cannot change type for property ││ 'PullDate' in container 'space:container'. | code: 400 Notes;This container contains data before this change We incremented the model version to a new major one We have consumers consuming the current versionWhat is the best practice for handling this kind of changes with the least effect on our current consumers ?  Thanks,

Hello,  We noticed that we get throttled (429 HTTP responses) on our backend whenever we make more than 10 req/sec. Is this a soft limit? Could we increase it? Thanks

Hello,  Does CDF provide CDC connectors/extractors for common SQL databases ?  Thanks

I have a use case where I need to filter events from CDF based on a “string.contains” pattern. Is this possible with the current API? Consider the following metadata field for an event in CDF. "EventData": "[{"version":"2.0.0"},{"type":"opcae"},{"id":"1d21002a-77a2-4531-a9bf-27f28876f2e1"},{"source":"47-PA-9810B-M01"},{"time":"5/29/2024 8:56:41 AM"},{"eventType":"Simple"},{"eventCategory":3439269159},{"eventCategoryName":"Process Simple Event"},{"severity":404},{"message":"Start"},{"eventCounter":187718259},{"Class":127},{"ObjectDescription":"PH PotWtr Pump B"},{"PriorityLevel":5}]"The value for `EventData` is a JSON string that has not been unpacked as proper metadata fields. Several of these fields are relevant for us to filter events down to the relevant subset.It is unclear from the documentation whether the API supports the “string.contains” pattern. The only class that maybe sounds like it is relevant is the 

The PI AF Extractor is missing link to the documentation, is there someone that could add this in.For the PI extractor the links are there and something similar for the PI AF extractor would make it easy to navigate to the documentation. The PI AF looks like this:The documentation does exist and lies under this area, would be great if we could navigate from CDF directly to the documentation.https://docs.cognite.com/cdf/integration/guides/extraction/pi_af Regards,Markus PettersenAker BP - CDF Data Delivery