Product User Community

Hey everyone ! Welcome back to our data modeling adventure in CDF! In my first post, I tried to explain my understanding of the core concepts - spaces, containers, views, and the elusive knowledge graph. We learned how data models act as the foundation for unlocking the power of Cognite Data Fusion for your industrial data.This time, let's delve deeper into the world of views and containers - the essential ingredients that bring your data models to life! Beyond the Fundamentals: Unveiling Views and ContainersThink of a data model as a recipe. It doesn't contain the actual ingredients (data) itself, but it tells you exactly what pre-made dishes (views) and fresh ingredients (containers) to use. Views: The Pre-Assembled Data: Imagine views as pre-prepared dishes – Views are essentially pre-defined data selections curated from specific containers. These containers hold the raw data (think sensor readings or equipment properties). A single view, akin to a pre-made sauce, can be referenced

I am facing this error in the data science course on “creating cognite functions” with cognite SDK. In previous courses I had fixed this error by replacing the “datapoints” keyword with “time_series”. However, I would like to know if I am probably not using the write packages; OR not know if the commands are deprecated and have new function names in newer versions. Kindly let me know - I am trying to finish these courses before my local boot camp next week.Thanks,Lavanya

Hello,I’m encountering an issue with accessing a dataset on Cognite Jupyter Notebooks. According to this link: Jupyter Notebook in Cognite Data Fusion | Cognite Documentation, subfolders will appear empty if I don’t have access to the dataset. However, I can see the dataset through the data model corresponding to that dataset, but I still can't see any contents inside the subfolders.Do I need anotther type of access or is it another issue? Any help would be much appreciated.Thanks!

Hey guys. I’m trying to create a function with some different constants. Do you know how can I change the name of the constants? 

Hi,I have some questions on Cognite. Would you please help?1. Files1.1 To delete Cognite files, after deleting the files do we need to delete the documents also? 1.2 After we create the files, the documents are created by Cognite automatically, but it seems there are some random delay to create the document, why?1.3 what is the concept of document in Cognite? Why is it created? Any documents on that?2. sequences2.1 To delete Cognite sequences, after deleting the sequences do we need to delete the datapoints also? 3. timeseries3.1 To delete Cognite timeseries, after deleting the timeseries do we need to delete the datapoints also?4. delete order for containers, views 4.1 to delete all FDM data in a space, the order of deletion should be edges, nodes, containers, view versions, data models, space. And the containers should be deleted first then delete the view versions, right?Thank you!Alice

I’m working on a prototype for a flexible data model to store time series data in a way that is easy to catalogue, query and filter. Using Pygen both to populate and use the model seems convenient.At its current iteration, I’ve only applied direct relations and (undocumented?) @reverseDirectRelations in the GraphQL schema. I expected to be able do something similar to client.windmill(windfarm="Hornsea 1").blades(limit=-1).sensor_positions(limit=-1).query()as found in the Pygen documentation, but it does not work (my client.windmill analouge has no methods corresponding to its relations). Do I have to use edges instead of relations to query easily and declaratively with Pygen?

This document outlines a concept that CDF has been under development for the last 2 years. As mentioned during the disclaimer above, please use this Cognite Hub group and share any feedback you have around flexible data modeling.This document is reflecting some very early thinking from the App Dev Journey team, and is a mental model that will likely change overtime with your feedback!What is a Data Model​A data model enables users to customize the shape, structure their expectation of data. It plays a crucial part in building solutions (like data science models, mobile and web apps). But it is also is the core of an ontology, knowledge graphs, or industry standard.There are some crucial reasons why data models are effective for the industrial space. Data modeling enables explicit language, flexible customization, governed iteration, and enhanced accessibility towards data. Let's dive further into each of these qualities of data modeling. Data Model is Explicit​A data model needs to be

Dear community,We have been working with Python SDK developing functions and everything works fine, as expected.Now we have an IP development that has C# as base language. We need to call some of the Cognite Functions utilizing the .net SDK (https://github.com/cognitedata/cognite-sdk-dotnet)  but we are having troubles to call the functions trough .net.Has anyone been able to utilize Cognite Functions trough the .net SDK?Thank you all.Here is a snippet of the code: 

I am trying to create a Data Model in the UI. I can click ‘create data model’, name it, and land on the page with the editor and the pre commented pump/facility/documenation example. However I am not able to edit the graphql as anytime I try to edit in the editor I am told that I ‘cannot edit in read-only editor. Where is the toggle to disable the read-only editor?

After how much time retry of function get triggered on failing?Is there a way we can set the time to retrigger the function after function fails. It will be helpful to deal with rate limit in functions if any.

Hello, how can I delete all the time series of a dataset with python sdk?

Hello,I’m trying to consume data from FDM in Power BI. But I’m getting error (408) Request Timeout. I’m already filtering Power BI for only a few days of data, which brings an amount of data comparable to the amounts I have already consumed in Power BI. How can I solve it?

Hello,I am trying to follow along the first chapter in Data Engineer Basics - Integrate. I am trying to follow the first workbook : Authentication. When I try to install poetry, I get an error below.Can anyone let me know how I may troubleshoot? I am on mac, python 12 and pipx (instead of pip)  at ~/Library/Application Support/pypoetry/venv/lib/python3.12/site-packages/poetry/installation/chef.py:164 in _prepare      160│       161│                 error = ChefBuildError("\n\n".join(message_parts))      162│       163│             if error is not None:    → 164│                 raise error from None      165│       166│             return path      167│       168│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:Note: This error originates from the build backend, and is likely not a problem with poetry but with pyzmq (25.0.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "pyzmq (==25.0.2)"'.Th

Hi everyone! 👋We are thrilled to announce that the next major release of Cognite Data Fusion is just around the corner, launching on June 4th, 2024. This update is packed with exciting new features across our Industrial Tools and Data Operations capabilities.Head over to Product Updates for a sneak peek of what's coming! Tip: hit the subscribe button on Product Ideas, and you'll be notified instantly when our product leaders share product updates.We look forward to your feedback and appreciate your continued contributions!

What access capabilities do I need to run transformations as “Current User”. I have a user who don’t see “Run as current user” as in screen shot. Next screen shot is mine, and I can see it probably because I am added as admin 

Hi, Is it possible to use multiple clients for the same Cognite Function? I know the handle function only takes one client as argument, but is it possible to initialize another client inside the function? I want my Cognite function to read from prod environment, but write to dev environment, which necessitates two clients. Thanks.

Semantic search is a new service under the existing Documents API in Cognite Data Fusion. For details on what semantic search is and an introduction to the service, please see attached presentation below.The service lets you search for relevant parts (passages) of up to 100 documents by using advanced filters and semantic search queries. Semantic search works by comparing the semantic meaning of the search query to the semantic meaning of the document passages. The document passages are automatically derived and indexed upon file uploads (PDF only).The flow for using semantic search on set of documents is as follows: Upload the PDF documents to Cognite Data Fusion Query /documents/status to check if the document is ready  Query /documents/semantic/search to find relevant passages in the document(s)Documentation for the service is being developed. Please find documentation for the respective endpoints below:/documents/status /documents/semantic/search

Deployment of workflow , can you guide how we can automate deployment of cognite workflows using sdk 

Hey Data Workflows users!TL;DR If you’re using the workflow execution cancellation endpoint, with the python SDK or without, you will have to update your workflow execution cancellation calls before 29/05/2024. More information below.In our push towards making the Data Workflows API generally available in the June release, we aim to ensure a consistent and expected experience across the API. For this reason, we’ve decided to make a breaking change to the workflow execution cancellation endpoint. Endpoint changesIn summary, the cancellation endpoint now only allows the cancellation of a single execution at a time instead of allowing multiple executions to be cancelled in one call. The updated API documentation can be found here. The python SDK, starting from version 7.42.0, will now point to the new endpoint. An example call to the new endpoint using the Python SDK can be found here.TimelineThe new endpoint is already available for use. To assist with the transition, the old endpoint wi

While testing versions of the cognite-sdk python >= 7.37.0, we noticed a performance issue in the "retrieve_dataframe" method of the time series API for all versions 7.37.x ( x >= 0 and x <= 3). Example: For the same data window, we tested with version 7.0.0 and the latest versions. The processing time for version 7.0.0 in this method was less than 5 seconds, while for newer versions the processing time was 3 minutes.

Hi!We have decided to move the feature from “Integrate” to “Contextualize”. We believe the process of parsing documents is a contextualization process as this is a process that takes places when the data is in CDF. This change should be reflected by the end of the day.Regards,Redza RosliSoftware Engineer in AI in Data Onboarding

Hello Team I have a .pid file, generated from the https://hexagon.com/products/intergraph-smart-p-id  software. Is there a way in CDF to read the files directly - meaning I’d like to see the vector, layers and properties natively and not rely on generating a PDF and doing an OCR.If I must write a connector myself, how do I go about it? Is there an industry standard format for .pid file, is so perhaps there is business case to commercialize such a connector?Appreciate your hints!RegardsAlex 

While doing the CDF Fundamentals, I’ve found out that if you don’t select a Data Set ID while uploading your PDF file, you later won’t be able to link it to your Asset, as your Data Set won’t be found. Also I didn’t find a way to edit this later. I had to upload a new file and select my Data Set ID. Is this expected? What was confusing to me is the fact that the Data Set ID is marked as optional. If this is not the case, this should be flagged as mandatory in order to upload any file.

Hello,I am trying to follow along the Entity matching notebook in the data Engineering learning module. I am having trouble generating COGNITE SECRET to run the notebook - kindly let me know if I may have missed a lesson. thanks,Lavanya