Skip to main content

Developer Community

Join the discussions focusing on developing on top of Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 64 Topics
  • 175 Replies
64 Topics
N
Seasoned
Neerajkumar BhatewaraSchlumberger
asked in Developer Community
SDK - Questions around Global Config

Hello,What are the best practices around setting the max-workers for a sdk. If I do not set the Global Config all the default values for workers and retries would be picked correct ? Can you give any reference on how we can set GlobalConfig, I mean I did not see any way to pass the GlobalConfig to ClientConfig ?

25513
H
Practitioner
S
Seasoned
Sangavi MSeasoned
asked in Developer Community
SDK: extraction pipeline update method is not working as expected

I’m trying to use Update extraction pipelines method to update my extraction pipelines created. Here are some issues i face:1. I’m unable to update contacts for an extraction pipeline, it throws the below error:code - contact_info = [ExtractionPipelineContact(name="sangs", email="sm6@slb.com", role = "MAINTAINER", send_notification=True)]to_update = ExtractionPipelineUpdate(external_id="<PIPELINE-EXT-ID-2>")to_update.contacts.set(contact_info)client.extraction_pipelines.update(to_update)error - “CogniteAPIError: Unexpected field - items[0].update.contacts.set[0].send_notification - did you mean sendNotification? | code: 400 | X-Request-ID: 918d1113-6a5e-9d38-b850-61e3dc54c220 The API Failed to process some items. Successful (2xx): [] Unknown (5xx): [] Failed (4xx): [<PIPELINE-EXT-ID-2>, ...]”2. I’m unable to set the specified fields to None using sdk : description, source, schedule,documentation, name and dataset-id. Im able to set only metadata and raw-tables to None. Wond

1599
Mithila Jayalath
Seasoned Practitioner
S
Committed
sarojbalaCommitted
asked in Developer Community
Connect Cognite function to private end point Azure key vault to store confidential information

Hi Cognite Team,Is there any document which can show , how to fetch confidential information from private end point key vault  on Microsoft azure key vault. 

1449
S
Committed
Vishnuvallabha Iyengar
Committed
Vishnuvallabha IyengarCommitted
asked in Developer Community
Urgent Help Needed: Implementing Time-Series Models and Asset Hierarchy with Python SDK

Hello esteemed members of the Cognite community,I come to you with a sense of urgency and a deep need for expert guidance. I've been attempting to familiarize myself with Cognite for the last six months, and despite my best efforts, I find myself at an impasse with some critical aspects. My situation is time-sensitive, and I am truly hoping for your assistance to navigate this complex but fascinating journey.My Setup:Environment: Google Colab (Free version)SDK: Cognite Python SDKAssets: Wind Farm with two sub-assets (Asset A and Asset B)My Goals:Connect to Cognite Project via Python SDK: I need to use my client ID and client secret to establish a connection from Google Colab.Create Hierarchical Assets: My aim is to create a parent asset, named "Wind Farm," and within this parent asset, include two child assets, Asset A and Asset B.Upload Time-Series Data from CSV: I have CSV files containing wind-speed and wind-power data for Asset A and Asset B. I need to upload these as time-series d

1435
Vishnuvallabha Iyengar
Committed
L
Committed
Lucas Rosa AlvesCommitted
posted in Developer Community
Proposal to Reduce Query Timeouts in High-Volume Views

ContextQuerying views with a large number of instances (>1 million), we frequently encounter query timeout issues. This has become a critical bottleneck affecting application performance and user experience. To mitigate this, we introduced on the app layer a pre-query caching strategy:Before sending a query to Cognite, we aggregate the number of instance spaces for a given view using the endpoint /models/instances/aggregate. This result is stored in a cache layer. When a query is initiated, we check if the user included a space filter. If not, we append the known relevant spaces from the cache to the query filter. This approach has significantly reduced timeouts across our applications. However, it introduces new challenges:One request per view is still needed to fetch associated spaces. Cache invalidation must be managed periodically, especially as user capabilities may change. This workaround does not help with timeouts in the CDF UI or Infield tools, where we cannot control the q

1332
L
Committed
L
Committed
Lucas Rosa AlvesCommitted
asked in Developer Community
Unexpected Paging Behavior with Descending Sort on Cursorable Index — Clarification on forceCursorsDespitePerformanceHazard Flag

On behalf of CelaneseHi.I would like to report a potential issue with cursor-based pagination when sorting in descending order and request clarification on the undocumented forceCursorsDespitePerformanceHazard flag.We are executing a query against the view OEEEvent, which is defined with a cursorable BTREE index on the startDateTime property, as shown in the simplified schema below: type OEEEvent@container(  indexes: [    {      fields: ["startDateTime"]      identifier: "idx_oeev_startDateTime"      indexType: BTREE      cursorable: true    }  ]) {  startDateTime: Timestamp  endDateTime: Timestamp  totalDuration: Float} We are querying with the following time range filter: "startDateTime": {  "gte": "2024-12-31T00:00:00.000-03:00",  "lt":  "2025-05-01T00:00:00.000-03:00"} The result set includes 840 records.When applying a page size of 500 and using the following ascending sort configuration: {  "property": [    "INO-COR-ALL-DML",    "OEEEvent/472bdbcb9cd6f1",    "startDateTime"  ], 

1292
L
Committed
M
Seasoned
Marwen TALEBSeasoned
posted in Developer Community
MCP server for data models?

Hello, I was playing with this project (https://github.com/blurrah/mcp-graphql) and created an MCP server on top of a test CDF data model. You can then use an LLM that supports MCP clients to register your server and have the help of the LLM to analyse your data :) Here I used Claude desktop for example:  ​​​​​​This is a great way if we want to integrate CDF data models with in-house or local LLM models.Do you plan to release an official MCP server for CDF data models? Thank you,

1091
Anders Hafreager
Practitioner
H
Committed
Harshita SaiCommitted
asked in Developer Community
How to write the unit test for the list row?

Hi Team, I need help to write the unit test using pytest,below is the code:    row_list = cognite.raw.rows.list(file.destination.database, file.Extractor_Last_Run_Table, limit=-1,                               columns=["key", "LastUpdatedDatetime"]).to_pandas()    if not row_list.empty:        val = list(row_list[row_list.index.isin([file.Extractor_key])]['LastUpdatedDatetime'])Could you please help to write the unit test for above code?Thanks

1054
H
Committed
V
Active
Vipul GuptaActive
asked in Developer Community
Error while setting up environment for "Extractor-utils Library for Cognite Python SDK"

first of all i created a new environment with below codes.python -m venv envenv\scripts\activatepip install poetry poetry config virtualenvs.in-project truepip install pandas numpypip install cognite-sdkpip install "cognite-sdk[pandas, geo]"pip install cognite-extractor-manageronce all above code completed. I started running cogex init.I am getting below error.cogex initEnter extractor name: csv extractorEnter description: descEnter author: --I provided the cognite login mail id in name <mail id>Which template should be loaded?  simple: loads a generic template suitable for most source systems, using          a simple function as the main entrypoint for the extractor.          Most suitable for small and simple extractors.  class:  loads a generic template suitable for most source systems, using          a run method on a class as the main entrypoint for the extractor.          Most suitable for slightly bigger and more complicated extractors.  rest:   loads a template for extrac

1002
Mithila Jayalath
Seasoned Practitioner
Sharizan Mohd Redzuan
Seasoned
Sharizan Mohd RedzuanSeasoned
asked in Developer Community
CDF DataModel - Querying data using c# CogniteSdk

I am using CogniteSdk c# to query data model from CDF. When I tried to execute it, it did not return row items. Instead it just returned below result:What is the correct way to use the DataModel in C# CogniteSdk to return rows of data as per below? 

984
Sharizan Mohd Redzuan
Seasoned
S
Seasoned
Sangavi MSeasoned
asked in Developer Community
is there a distinct filter for Data modeling sdk instance query method

I'm using python sdk and wanted to query instances based on a condition using “data_modeling.instances.query” method. i have a view “TimeseriesProperty” and it has a direct relation/reference to "TimeseriesPropertyType" view. Is it possible to have a distinct filter on the result, because multiple “TimeseriesProperty” instances can have the same "TimeseriesPropertyType"  instances , we don't want duplicated "TimeseriesPropertyType"  instances coming in response for below query: view_id= ViewId(space="slb-pdm-dm-governed", external_id="TimeseriesProperty",version="2_0")v_id_2_PROP = ViewId(space="slb-pdm-dm-governed", external_id="TimeseriesPropertyType",version="2_0")query= Query( with_= { "TimeseriesProperty":NodeResultSetExpression( limit=10, filter= HasData(views=[view_id])), "TimeseriesPropertyType":NodeResultSetExpression( limit=10000, direction="outwards",

987
S
Seasoned
A
Committed
Anders NygaardCommitted
asked in Developer Community
Javascript SDK: getToken runs only some of the time when using CogniteClient

Across multiple javascript projects, we use the @cognite/sdk. We observe some strange behaviour when it comes to authentication and see the Chrome network panel full of HTTP 401 calls. When debugging the issue, we see that the getToken method supplied to the CogniteClient class only gets called some times. And when it does, the code on our part successfully retrieves a valid token. This leads to some unwanted behaviour and the user sometimes needs to refresh the browser in order to correct the browser state.I suspect the fact that we make a new instance of CogniteClient everytime we use it could be the culprit. I read from the source code baseCogniteClient.ts that the getToken function is not called each time in order to “To prevent calling `getToken` method multiple times in parallel”. Not that I am really able to follow this behaviour over multiple instances of the client.Any pointers as to what might cause this problem?const getToken = async () => {  // this code only hits some t

971
BugGambit
Practitioner
S
Seasoned
Sangavi MSeasoned
asked in Developer Community
Data modeling sdk instance query method filter

I'm using python sdk and wanted to query instances based on a condition using “data_modeling.instances.query” methos . I have a view called TimeseriesPropertyType which has a field (properties: [Property]) which is a reverse direct relation throughProperty: "propertyType".i just need to check if there are any “properties” field values associated with each instance of the TimeseriesPropertyType view. for that I'm fetching data in property view associated with those particular TimeseriesPropertyType view and doing the check manually in code.. is there any direct filter i can use that's available? i dont see any filters available on properties field in query explorer for the samebelow is the query im using #view_id_ts_prop_type - TimeseriesPropertyType view#view_id_property - Property viewquery= Query(with_= { "TimeseriesPropertyType":NodeResultSetExpression( limit=10000, filter= HasData(views=[view_id_ts_prop_type])), "Pr

895
S
Seasoned
S
Committed
ShwetaCommitted
posted in Developer Community
Creating query like cognite UI's query by SDK

Hi Everyone,I need to create query like it is creating on cognite UI’s  like   { "listEntity": { "with": { "0": { "limit": 50, "nodes": { "filter": { "and": [ { "matchAll": {} }, { "hasData": [ { "type": "view", "space": "slb-pdm-dm-governed", "externalId": "Entity", "version": "1_7" } ] }, { "or": [ { "and": [ { "nested": { "scope": [ "slb-pdm-dm-governed", "Entity/1_7", "parent" ],

887
H
Practitioner
L
Committed
Lucas Rosa AlvesCommitted
asked in Developer Community
Issue with activities Field in CogniteAsset View – Invalid Reverse Relation

Hi everyone,While querying the CogniteAsset view, I encountered an error when including the activities field in the selection. The API returns the following message: "Cannot traverse lists of direct relations inwards." Upon investigating, I noticed that the activities field in the CogniteAsset view is defined as a @reverseDirectRelation: activities: [CogniteActivity] @reverseDirectRelation(throughProperty: "assets") In turn, the assets field in the CogniteActivity view is defined as a list of direct relations:assets: [CogniteAsset] @directRelationThis makes sense as the root cause, since reverse traversal over a list of direct relations is not allowed, which explains the error.Given that this field leads to an invalid query pattern and always results in an error, should the activities field be removed from the CogniteAsset view to avoid confusion and runtime errors? Here’s a minimal query that reproduces the issue:query MyQuery {  listCogniteAsset {    items {      aliases      activit

804
L
Committed
H
Active
Haris vkActive
asked in Developer Community
Working with cdf demo project

Hi Cognite Team,I'm building a React dashboard using Cognite Data Fusion for my portfolio and would like to know if there are any demo projects available for working with CDF data.

709
Anders Albert
Seasoned Practitioner
P
Active
Pranjul SinghActive
asked in Developer Community
Trigger a workflow once a new instance is inserted in Data Model container

Hello experts,We want to achieve the following workflow:Once a new instance is created/added in our datamodel container Another workflow must be triggered immediately We do not want to create a scheduled based polling to invoke our workflow since our workflow is time sensitive and high importanceCould you please let us know if CDF supports this functionality? Or suggest a way to achieve it.I have explored the CDF in my limited knowledge, I found that subscription is available on Data Model, but it is not enabled in our environment.Could you please help me in this.Thanks,Pranjul Singh  ​​​​​​​    

685
Everton Colling
Seasoned Practitioner
J
Active
Jan DolejsiActive
asked in Developer Community
Cognite Data Fusion Python SDK - how to delete edges that lead to a node with a specific target_edge_id?

I am using the [Cognite Data Fusion Python SDK](https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_modeling.html#delete-instances). While deleting a node, e.g....```pythonclient.data_modeling.instances.delete(NodeId(space='some-space', external_id=deleted_node_id))```I want to also delete the edge(s) from the parent in order to avoid leaving orphan edges in the database.**Problem**: how can I look-up such edges? I know how to get all edges (and then filter by the `end_node` attribute), but that would be very inefficient:```pythonedges = client.data_modeling.instances.list(    instance_type="edge", limit=-1)```How could I construct the `Filter` for the `end_node` (to match the `deleted_node_id`) and ideally the `type` (to equal `Child` type)? E.g.```pythonedges = client.data_modeling.instances.list(    instance_type="edge",     filter=And(Equal(???), Equal(???)),    limit=-1)```Because then I could just delete all those edges with one `client.data_modeling.instances.delete

671
Mithila Jayalath
Seasoned Practitioner
Anders Brakestad
Seasoned
Anders BrakestadSeasoned
asked in Developer Community
Limitations in Incremental refresh in power BI using CDF connector

Use CaseI am building a dashboard in Power BI that will visualize Events from CDF (about one million events per year). So to make the solution scale I want to use incremental refresh of the semantic model so I only refresh the model with the newest Events since the last refresh.I have followed your tutorial on Incremental refresh (which seems copy/paste of Microsoft’s tutorial), but I still have questions:What happens if the StartTime attribute of an Event is a date/time/zone when loaded into the model? The attribute needs to be a date/time type, which means I need to convert the type first. How will the incremental refresh work if the model needs to load the data in order to convert the type, and then apply the RangeStart/RangeEnd filters? Can I use Incremental refersh with the new REST API Connector? When I load events with the new connector I get the start times as number of milliseconds since epoch. So the type conversion from above also applies here. Thanks for your help!Anders

647
Anders Brakestad
Seasoned
Y
Committed
Yatish PittaCommitted
asked in Developer Community
How to populate Edge properties?

Hi,I understand that we can define properties on edges, but it isn’t clear from the documentation how these properties are populated. I am trying to implement the following modelAnd defined the data model using DML as follows How can I add a UserActivity edge with properties start_time and stop_time, that I can read while listing all the activities that a User has performed?Thank you

611
Arild Eide
Seasoned Practitioner
S
Committed
ShwetaCommitted
asked in Developer Community
Checking for how many view's instance, an edge is present.

Hello Team,I am trying to check like how many edges(entities in my case) are null in the view(event) is there any specific way to do so? I am trying right now sdk query api like below, but not working. Please give your insights. {    "with": {        "Event": {            "nodes": {                "filter": {                    "hasData": [                        {                            "type": "view",                            "space": "slb-pdm-dm-governed",                            "externalId": "Event",                            "version": "1_7"                        }                    ]                },                "chain_to": "destination",                "direction": "outwards"            },            "limit": 10000        },        "Event_2_entities.Entity": {            "edges": {                "from": "Event",                "direction": "outwards",                "filter": {                    "and": [                        {                            "equ

504
S
Committed
S
Active
sreeslbActive
asked in Developer Community
Cognite Python sdk - Getting All Linked Timeseries of a Asset

Hi Experts, Need your help on Cognite Python sdk.My goalGet all linked timeseries of an AssetI am using Asset class object https://cognite-sdk-python.readthedocs-hosted.com/en/latest/assets.html#cognite.client.data_classes.assets.Asset time_series function​​  ProblemIt is only giving me  the ‘Directly linked timeseries’ , not all the ‘Linked timeseries.   Means in this case I only getting 13 timeseries objects , compared to 64 linked timeseries of the Asset. Appreciate your help on adopting the correct approach Thanks and RegardsSree

481
Ben Petree
Seasoned Practitioner
G
Active
Gabriel Neves MacielActive
asked in Developer Community
IAM Sessions (Python SDK)

I need some help with the SDK (Python). I'm trying to list active sessions in Cognite using the following resource: client.iam.sessions.list(status="ACTIVE" However, I notice that even my client_id doesn't return in the listing (I'm logged in via browser with my user). Am I misunderstanding this feature?

462
Dilini Fernando
Seasoned Practitioner
M
Seasoned
Marwen TALEBSeasoned
asked in Developer Community
How cdf toolkit resolve dependencies between views ?

Hello, We are using cdf toolkit to deploy our container, views and data models.We recently added many new views, these views are dependent. i.e: they reference each other in the properties through a source block or via implements block. Here an examples of these view dependencies:- externalId: View1 implements: [] name: View1 properties: test: container: externalId: Container1 space: some_space type: container containerPropertyIdentifier: Test name: test source: externalId: View2 space: some_space type: view version: v1 space: some_space version: v1- externalId: View2 implements: [] name: View2 properties: wow: container: externalId: Container2 space: some_space type: container containerPropertyIdentifier: Test name: wow space: some_space version: v1or - externalId: Country implements: - externalId: CountryAttributes space: '{{sp_dm_dap_knowledge_graph}}_wv'

465
M
Seasoned
Ayush Daruka
Seasoned
Ayush DarukaSeasoned
asked in Developer Community
Non-writable error while populating data into new version of a view

Hi,I have a view called "Entity" in an existing model with mandatory properties "name", "description" and "isVirtual".Now, I have a new version of "Entity" in which I have decided to implement CogniteDescribable from CDM for name and description, where these fields are not mandatory.When I try to ingest data into the new version of this view, it gives me a non-writable error since the mandatory properties that I had created for the older version is not getting populated.Is there any way to overcome this?Can I map the mandatory container to the container used in CogniteDescribable, so that when I ingest data in the new version, it automatically ingests the mandatory container as well?If yes, can you please share a YAML example of the same to be deployed through toolkit?Please note that both the mandatory and non-mandatory containers have the same name "name".

444
Ayush Daruka
Seasoned

Badge winners

  • Cognite Sales Enablement Basics
    Sonia Buliganhas earned the badge Cognite Sales Enablement Basics
  • Cognite Domain Expert Basics
    Oren Feinsteinhas earned the badge Cognite Domain Expert Basics
  • Cognite Maintain Practitioner
    Shruti Sawanthas earned the badge Cognite Maintain Practitioner
  • Cognite InRobot Practitioner
    Shruti Sawanthas earned the badge Cognite InRobot Practitioner
  • Cognite Data Fusion Fundamentals
    Luks Anetahas earned the badge Cognite Data Fusion Fundamentals
Show all badges
Terms & ConditionsCookie Settings