Skip to main content

Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 800 Topics
  • 2,529 Replies
800 Topics
Elka Sierra
Seasoned Practitioner
Elka SierraSeasoned Practitioner
published in Developer and User Community
Continuing My Data Modeling Journey: Understanding the Essentials

Hey everyone ! Welcome back to our data modeling adventure in CDF! In my first post, I tried to explain my understanding of the core concepts - spaces, containers, views, and the elusive knowledge graph. We learned how data models act as the foundation for unlocking the power of Cognite Data Fusion for your industrial data.This time, let's delve deeper into the world of views and containers - the essential ingredients that bring your data models to life! Beyond the Fundamentals: Unveiling Views and ContainersThink of a data model as a recipe. It doesn't contain the actual ingredients (data) itself, but it tells you exactly what pre-made dishes (views) and fresh ingredients (containers) to use. Views: The Pre-Assembled Data: Imagine views as pre-prepared dishes – Views are essentially pre-defined data selections curated from specific containers. These containers hold the raw data (think sensor readings or equipment properties). A single view, akin to a pre-made sauce, can be referenced

1961
Andreas Prøsch
Practitioner
3 months ago
Pierre Pernot
Seasoned Practitioner
Pierre PernotSeasoned Practitioner
published in Developer and User Community
Cognite Replicator

A common setup that we have at Cognite is having 3 different environments: development, test and production. We have one specific Cognite Data Fusion (CDF) project for each of these environments. This setup allows to develop new features without interfering with production data. Also, it makes the deployment of new features to production much safer, since they are tested before.Sometimes, you still want to have the data you used during your tests, in your production environment. For example, if you extracted some data from sensors and saved them as time series in CDF, you may want to keep this historical data when you move to production. Same goes with files, assets, datasets, functions etc. Another example could be the replication of the data from a full production CDF project, to one of your customer’s project, containing only a subset of the source one.At Cognite, we have a python package (available at https://pypi.org/project/cognite-replicator/) whose purpose is to copy the select

1534
R
Active
3 months ago
L
Active
Lavanya KannanActive
asked in Developer and User Community
client.datapoints.retrieve_dataframe() returns an error 'CogniteClient' object has no attribute 'datapoints'

I am facing this error in the data science course on “creating cognite functions” with cognite SDK. In previous courses I had fixed this error by replacing the “datapoints” keyword with “time_series”. However, I would like to know if I am probably not using the write packages; OR not know if the commands are deprecated and have new function names in newer versions. Kindly let me know - I am trying to finish these courses before my local boot camp next week.Thanks,Lavanya

3
Dilini Fernando
Seasoned Practitioner
3 months ago
H
Seasoned
Hugo LopesSeasoned
asked in Developer and User Community
404 Error When Sharing Jupyter Notebook via Shareable Link

Hello,I’m having trouble sharing a Jupyter notebook on Cognite. I used the right-click option to copy the shareable link, but when I or others click on the link, we encounter a 404 error like the following: Has anyone else experienced this issue? Also, they can’t find the notebook going to the folder, only myself can see it.Thanks!

3
Lars Moastuen
Seasoned Practitioner
3 months ago
Andre Alves
Practitioner
Andre AlvesPractitioner
asked in Developer and User Community
End-to-end ML Models Management

Are there any documented use cases or papers on integrating MLflow with Cognite, or is it something we need to implement ourselves?For example, if we aim to seamlessly integrate the MLflow UI with Cognite to evaluate and select the top-performing models, we could leverage SQLite, which operates on the local file system (e.g., mlruns.db) and provides a built-in client, sqlite3. However, our preference is to seamlessly integrate it with Cognite.

2
Andre Alves
Practitioner
3 months ago
Sofie Haug
Practitioner
Sofie HaugCognite Academy Instructor
published in Developer and User Community
Exciting news: Upcoming Cognite Data Fusion Bootcamps in Houston and Oslo

We are thrilled to announce the dates for our upcoming Cognite Data Fusion (CDF) Delivery Bootcamps in Houston and Oslo. Are you a customer or partner of Cognite working on a future CDF project? If so, this Bootcamp might be perfect for you! The Cognite Data Fusion Bootcamp is a 5-day intensive, in-person training designed to help you develop an end-to-end, production-ready solution with CDF. This program is ideal for technical users who will be ingesting and contextualizing data and creating solutions. To make the most of this Bootcamp, participants must complete the prerequisites and have experience with Python, poetry, SQL, Azure Active Directory, and GitHub/GitOps. Upcoming Bootcamp dates in Houston: September 23rd - September 27th 2024 October 21st - October 25th 2024 November 18th - November 22th 2024 December 9th - December 13th 2024 Upcoming Bootcamp dates in Oslo: October 14th - October 18th 2024 November 11th - November 15th 2024 December 2nd - December 6th 2024     

1570
Sofie Haug
Practitioner
3 months ago
H
Seasoned
Hugo LopesSeasoned
asked in Developer and User Community
Unable to View Content Despite Having Access to Dataset

Hello,I’m encountering an issue with accessing a dataset on Cognite Jupyter Notebooks. According to this link: Jupyter Notebook in Cognite Data Fusion | Cognite Documentation, subfolders will appear empty if I don’t have access to the dataset. However, I can see the dataset through the data model corresponding to that dataset, but I still can't see any contents inside the subfolders.Do I need anotther type of access or is it another issue? Any help would be much appreciated.Thanks!

1
Lars Moastuen
Seasoned Practitioner
3 months ago
Karinnensantos
Seasoned
KarinnensantosSeasoned
asked in Developer and User Community
Rename Constant

Hey guys. I’m trying to create a function with some different constants. Do you know how can I change the name of the constants? 

4
Dilini Fernando
Seasoned Practitioner
3 months ago
A
Committed
Alice AiCommitted
asked in Developer and User Community
Delete Cognite data questions

Hi,I have some questions on Cognite. Would you please help?1. Files1.1 To delete Cognite files, after deleting the files do we need to delete the documents also? 1.2 After we create the files, the documents are created by Cognite automatically, but it seems there are some random delay to create the document, why?1.3 what is the concept of document in Cognite? Why is it created? Any documents on that?2. sequences2.1 To delete Cognite sequences, after deleting the sequences do we need to delete the datapoints also? 3. timeseries3.1 To delete Cognite timeseries, after deleting the timeseries do we need to delete the datapoints also?4. delete order for containers, views 4.1 to delete all FDM data in a space, the order of deletion should be edges, nodes, containers, view versions, data models, space. And the containers should be deleted first then delete the view versions, right?Thank you!Alice

1
Dilini Fernando
Seasoned Practitioner
3 months ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community
What is Flexible Data Modeling

This document outlines a concept that CDF has been under development for the last 2 years. As mentioned during the disclaimer above, please use this Cognite Hub group and share any feedback you have around flexible data modeling.This document is reflecting some very early thinking from the App Dev Journey team, and is a mental model that will likely change overtime with your feedback!What is a Data Model​A data model enables users to customize the shape, structure their expectation of data. It plays a crucial part in building solutions (like data science models, mobile and web apps). But it is also is the core of an ontology, knowledge graphs, or industry standard.There are some crucial reasons why data models are effective for the industrial space. Data modeling enables explicit language, flexible customization, governed iteration, and enhanced accessibility towards data. Let's dive further into each of these qualities of data modeling. Data Model is Explicit​A data model needs to be

1
APSHANKAR Sagar
Committed
3 months ago
fco.parga
Active
fco.pargaActive
asked in Developer and User Community
Functions with .NET

Dear community,We have been working with Python SDK developing functions and everything works fine, as expected.Now we have an IP development that has C# as base language. We need to call some of the Cognite Functions utilizing the .net SDK (https://github.com/cognitedata/cognite-sdk-dotnet)  but we are having troubles to call the functions trough .net.Has anyone been able to utilize Cognite Functions trough the .net SDK?Thank you all.Here is a snippet of the code: 

1
Everton Colling
Practitioner
3 months ago
Z
Active
Zebulon BellActive
asked in Developer and User Community
Data Model Read-Only Editor

I am trying to create a Data Model in the UI. I can click ‘create data model’, name it, and land on the page with the editor and the pre commented pump/facility/documenation example. However I am not able to edit the graphql as anytime I try to edit in the editor I am told that I ‘cannot edit in read-only editor. Where is the toggle to disable the read-only editor?

2
Z
Active
3 months ago
Pablo Palacios
Seasoned
Pablo PalaciosSeasoned
asked in Developer and User Community
Delete time series SDK Python

Hello, how can I delete all the time series of a dataset with python sdk?

2
Pablo Palacios
Seasoned
3 months ago
P
Active
pablo.souzaActive
asked in Developer and User Community
Power BI time out

Hello,I’m trying to consume data from FDM in Power BI. But I’m getting error (408) Request Timeout. I’m already filtering Power BI for only a few days of data, which brings an amount of data comparable to the amounts I have already consumed in Power BI. How can I solve it?

2
Dilini Fernando
Seasoned Practitioner
3 months ago
L
Active
Lavanya KannanActive
asked in Developer and User Community
Having trouble instantiatiating a CogniteClient

Hello,I am trying to follow along the first chapter in Data Engineer Basics - Integrate. I am trying to follow the first workbook : Authentication. When I try to install poetry, I get an error below.Can anyone let me know how I may troubleshoot? I am on mac, python 12 and pipx (instead of pip)  at ~/Library/Application Support/pypoetry/venv/lib/python3.12/site-packages/poetry/installation/chef.py:164 in _prepare      160│       161│                 error = ChefBuildError("\n\n".join(message_parts))      162│       163│             if error is not None:    → 164│                 raise error from None      165│       166│             return path      167│       168│     def _prepare_sdist(self, archive: Path, destination: Path | None = None) -> Path:Note: This error originates from the build backend, and is likely not a problem with poetry but with pyzmq (25.0.2) not supporting PEP 517 builds. You can verify this by running 'pip wheel --no-cache-dir --use-pep517 "pyzmq (==25.0.2)"'.Th

3
Dilini Fernando
Seasoned Practitioner
3 months ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreHead of Academy and Community
posted in Developer and User Community
Exciting New Features Coming to Cognite Data Fusion on June 4th, 2024!

Hi everyone! 👋We are thrilled to announce that the next major release of Cognite Data Fusion is just around the corner, launching on June 4th, 2024. This update is packed with exciting new features across our Industrial Tools and Data Operations capabilities.Head over to Product Updates for a sneak peek of what's coming! Tip: hit the subscribe button on Product Ideas, and you'll be notified instantly when our product leaders share product updates.We look forward to your feedback and appreciate your continued contributions!

0
Anita Hæhre
Seasoned Practitioner
3 months ago
J
Seasoned
Jatin SablokSeasoned
asked in Developer and User Community
Access Capabilities

What access capabilities do I need to run transformations as “Current User”. I have a user who don’t see “Run as current user” as in screen shot. Next screen shot is mine, and I can see it probably because I am added as admin 

3
Dilini Fernando
Seasoned Practitioner
3 months ago
P
Committed
Patrick GallerCommitted
asked in Developer and User Community
Downloading list of timeseries with metadata?

I am looking at 127 time series linked to one asset and I want to download the list of these time series as shown in the screenshot below, but this doesn’t appear to be straight forward.The download button circled in blue saves a JSON file linked only to the asset “11. QHP”. Is there a way to spare the user the effort of manually selecting and downloading each of the 127 timeseries and later reassemble them into one table like the one shown in the browser?  It is not possible to select and display more than 20 columns in the browser … due to performance issues. This is not critical at this time, but still dissatisfying. I want to download everything wholesale and pick what I need from the list locally. Is there a way around this restriction? Solving issue #1 would remedy also #2, as I’d be able to join the tables locally again. Thanks

5
roman.chesnokov
Seasoned Practitioner
3 months ago
V
Committed
Vetle NevlandCommitted
asked in Developer and User Community
Handle multiple clients in Cognite Functions

Hi, Is it possible to use multiple clients for the same Cognite Function? I know the handle function only takes one client as argument, but is it possible to initialize another client inside the function? I want my Cognite function to read from prod environment, but write to dev environment, which necessitates two clients. Thanks.

1
M
Seasoned Practitioner
3 months ago
S
Active
SouzaActive
asked in Developer and User Community
Performance Issue cognite-sdk

While testing versions of the cognite-sdk python >= 7.37.0, we noticed a performance issue in the "retrieve_dataframe" method of the time series API for all versions 7.37.x ( x >= 0 and x <= 3). Example: For the same data window, we tested with version 7.0.0 and the latest versions. The processing time for version 7.0.0 in this method was less than 5 seconds, while for newer versions the processing time was 3 minutes.

3
Andre Alves
Practitioner
4 months ago
A
Committed
Alex NarayananCommitted
asked in Developer and User Community
Reading PID files.

Hello Team I have a .pid file, generated from the https://hexagon.com/products/intergraph-smart-p-id  software. Is there a way in CDF to read the files directly - meaning I’d like to see the vector, layers and properties natively and not rely on generating a PDF and doing an OCR.If I must write a connector myself, how do I go about it? Is there an industry standard format for .pid file, is so perhaps there is business case to commercialize such a connector?Appreciate your hints!RegardsAlex 

5
Q
Practitioner
4 months ago
Carlos.Herrera
Practitioner
Carlos.HerreraPractitioner
asked in Developer and User Community
Unable to link an engineering diagram to assets

While doing the CDF Fundamentals, I’ve found out that if you don’t select a Data Set ID while uploading your PDF file, you later won’t be able to link it to your Asset, as your Data Set won’t be found. Also I didn’t find a way to edit this later. I had to upload a new file and select my Data Set ID. Is this expected? What was confusing to me is the fact that the Data Set ID is marked as optional. If this is not the case, this should be flagged as mandatory in order to upload any file.

3
Brad Downen
4 months ago
L
Active
Lavanya KannanActive
asked in Developer and User Community
How to get COGNITE SECRET for the (Entity Matching) project?

Hello,I am trying to follow along the Entity matching notebook in the data Engineering learning module. I am having trouble generating COGNITE SECRET to run the notebook - kindly let me know if I may have missed a lesson. thanks,Lavanya

1
Sofie Haug
Practitioner
4 months ago
I
Seasoned
ibrahim.alsyedSeasoned
asked in Developer and User Community
Cognite Charts: Calculations published back to CDF

Are Cognite Charts calculations published back to CDF?

4
P
4 months ago
L
Active
Lavanya KannanActive
asked in Developer and User Community
Postman - getting 404 Not Found error while making a test API request

Hi, I am on Data Engineer Learn training. When I try to make my first API request for the publicdata project, I get a 404 Not Found error: The GET url I was asked to use is{{baseurl}}/api/v1/projects/{{project}}/assets I also replaced {{project}} with ‘publicdata’ with same result. Kindly let me know.

5
Dilini Fernando
Seasoned Practitioner
4 months ago

Badge winners

  • Cognite Data Engineer Basics - Integrate
    Jayhas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Fusion Fundamentals
    Bhushan Kumarhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Kyu3has earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Kevin Caputohas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Scotthas earned the badge Cognite Data Fusion Fundamentals
Show all badges
Terms & ConditionsCookie Settings