Join the discussions focusing on developing on top of Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
Hi Everyone,Is there a way to create an alert directly on a calculated series in Cognite Charts?From what I’ve found, to create an alert for a calculation, I first need to schedule the calculation and then run the alert on that scheduled result. However, scheduling doesn’t seem to work well in my case.For example, if I receive machine data every hour, I also need to schedule the calculation every hour. Sometime scheduling stops by itself. It would be much easier if we could create alerts directly on the calculation without scheduling.Secondly, I’m not finding clear documentation or videos on how to schedule calculations properly and what best practices to follow. If anyone has experience with this or can share guidance, please let me know.Thanks!
Hello, When I’m connecting to the virtual machine Ubuntu, I’m facing a pop-up “connection failed”. It seems that my internet connection is not set up, do you have any idea to do so ? I’m not able to do rest of the training without connection. Thanks
Hi everyone,As we prepare for the General Availability release of Records in CDF on December 2nd, 2025, we're implementing important changes based on learnings from the Private Beta program.Timeline: These changes will be rolled out progressively between today and December 2nd, 2025. We'll update this post as specific changes go live.What's changing:Record-specific containers We are introducing a new type of container dedicated to records, which has higher limits for number of properties, and will allow evolution of the records specific container as more features are made available in records. This container is defined by the usedFor field set to "record". It will be possible to ingest records only into containers with usedFor set to "record" Any records already ingested into non-record containers will remain queryable, but new ingestion attempts to these containers will fail This separation enables better schema management, clearer data organization, and simpler logic for clients q
Hello, We are facing an issue using private SSL certificate with Cognite REST extractor, we are receiving this error: While executing request to <URL>: HTTP response error: 400 Bad Request. Body: <html> <head><title>400 No required SSL certificate was sent</title></head> <body> <center><h1>400 Bad Request</h1></center> <center>No required SSL certificate was sent</center> It seems that the extractor does not send the certificate, could you please help? Thanks!
I am facing issue of jupyter notebook getting crashed frequently. Sharing the image for reference.
Hi Everyone!I need to manage streamlit applications (read / update files) using the Cognite SDK or with the API.I was able to publish streamlit applications using the cognite toolkit, but I also need to read them.Tried searching the api-docs and cognite-sdk docs with no luck. Thank you!
In the process of initializing a new CDF tenant for one of our customers I am getting the following error when adding Assets Read/Write capabilities: 1 invalid capabilitie(s) are present: {"assetsAcl":{"actions":["READ","WRITE"],"scope":{"all":{}}}} (invalid capability - write access to the legacy Assets API is restricted) | code: 400 | Are core assets now restricted?
Hi Team, we have data in format like list of externalIds and space as key and value. Like list of Json object in data model. something like [{externalId:well,space:slb},{externalId:well1,space:slb2}]So can we keep a field in model like violatedEntities: [JsonObject]Is it possible to parse all the externalIds and store it like this?Thank you.
Hello, I have two questions:When using cdf_nodes in transformation, does query optimizer take advantage of the container indexes? What we notice is it is not the case. How can we run broadcast joins in transformation. Hints does seem to be working: https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-hints.htmlThank you!
WITH archived_wells AS ( SELECT DISTINCT ac.WellId FROM cdf_nodes( 'sp_dm_dap_knowledge_graph', 'Activity', '0.71' ) ac JOIN contextualization.dap_wellview_wellid_space_mapping map ON ac.WellId = map.key WHERE map.Archived = TRUE AND ac.Archived = FALSE)SELECT s.externalId, s.space, s.WellId, true as ArchivedFROM cdf_nodes( 'sp_dm_dap_knowledge_graph', 'WellState', '0.71' ) sJOIN archived_wells aw ON s.WellId = aw.WellIdWHERE s.Archived = FALSE AND EXISTS ( SELECT 1 FROM archived_wells )WellState has 20M rows of data. To improve SQL performance, I want to use a CTE to get the IDs of archived wells and then update WellState (archived and WellId are indexed). However, I found that even when using EXISTS to check that the CTE result is empty, cdf_nodes still loads instances. In this case, shouldn’t the result just be empty?Additionally, when I replaced the CTE with a subquery,
Hi everyone,As we prepare for the General Availability (GA) release of Records in CDF, we're implementing important changes based on learnings from the Private Beta. These changes will take effect on November 3rd, 2025.What's ChangingStream Limits per CDF Project:Active streams: reduced from 10 to 3 Soft-deleted streams: reduced from 100 to 30Stream Templates: We're streamlining from 6 private beta-phase templates to 3 templates:ImmutableTestStream - for experimentation only BasicArchive - for perpetual data storage (immutable) BasicLiveData - for production usage (mutable)The following beta templates will no longer be available for new stream creation:ImmutableDataStaging ImmutableNormalizedData ImmutableArchive MutableTestStream MutableLiveDataIf you're using ImmutableTestStream, note that the template capacity has been significantly reduced. The maximum total records decreased from 5B to 50M, and the maximum total data volume decreased from 500GB to 50GB.Existing streams will retain
Hi all, looking for guidance on two issues we hit with CDF related to timeseries visibility and datamodel queries.403 error leaking timeseries externalIds:when a user without access requests a timeseries resource, a 403 error is returned as expected, but the error body contains the externalIds of the timeseries. Those externalIds are sensitive and should not be exposed to users who don’t have access.Is it expected behavior that externalIds are included in 403 error messages? If not, is there a setting / configuration / log-level that controls whether identifiers are returned in errors? Any recommended mitigation or planned fix? Datamodel query returns datapoints from unauthorized timeseriesSetup: Created dataset_1 and dataset_2 Created two timeseries, TS_A in dataset_1 and TS_B in dataset_2 Attached both TS_A and TS_B to a datamodel Granted the user only timeseries:READ scope:dataset_2 (so they should see TS_B only) Observed behavior: querying the datamodel returns datapoints for T
Hi, Data models names are limited to 37 chars today. Is this a hard limit? Is there a way to extend this so we can have more possibilities for internal naming conventions? Thank you!
Hello, We are using cdf toolkit to deploy our data models. We have a relatively a big data models that uses 478 views. Each time we deploy a breaking change our data model architecture (well centric) obliges us to redeploy a new version for all views. We notice a huge deployment time at the dependencies resolution step: 2025-08-19T09:34:54+00:00 WARNING [LOW]: Failed to create 478 views: One or moreviews do not exist: 'sp_dm_mud_brines_for_ops_real_wview:Activity/0.10'.. Attempting to recover...The overall deployment time takes 35 mins, this way bigger than our standard CI/CD job duration where we try to keep it under 10min at worst. Is there a way to optimize this please? Thank you!
I created an asset hierarchy with the Cogntie Core Data Model, then I created a custom data model through neat and I need to migrate the assets from the core data model to the custom extended data model, I tried creating a transformation but got the following error: failed with status 403: Properties [assetHierarchy_path, assetHierarchy_path_last_updated_time, assetHierarchy_root] are maintained by DMS and cannot be modified by end users. is there a way I can migrate/update the core data model assets to our extended data model?
Hi,Context:We currently organize our data in CDF using a per-country partitioning strategy, where each country has its own space.This approach was chosen primarily to restrict data access by country in a fine-grained manner.On top of that, we expose data models grouped by Business Object, such as Well Architecture, Cost Model, etc.Each Business Object model aggregates several data objects under a common business theme, which also allows us to control access by business domain in addition to country-based access.We are now planning to integrate a large amount of historical data, which will likely increase our model size by around 4x.These historical datasets are rarely queried, but we want to make sure their addition does not degrade performance for operational data — both in query latency and data ingestion throughput.We are evaluating two potential strategies: Keep everything in the same spaces, adding an indexed attribute (e.g., is_legacy = true) to distinguish legacy records. Crea
While I try to insert a Stream (using the http post as shown in the Getting Started guide), I am getting the next error:cognite.client.exceptions.CogniteAPIError: Project 2982735218914002 not enabled for Industrial Log Analytics | code: 400 | X-Request-ID: 66573df8-87ce-9b37-a837-180aee796a6c | cluster: westeurope-1 | project: slb-mmv-ops-dev This detail isn’t mentioned anywhere on the documentation. I cannot find how to change that. Can you enable ILA for https://delfi-dev.fusion.cognite.com/slb-mmv-ops-dev/?
I am stumbling through the Beta documentation. When I try to run the http post to create a Stream (as described here), I get this error:The feature can only be used with [alpha, beta] headersI found documentation that seemed relevant, but it seems the format of the header is this cdf-version: 20230101-beta https://api-docs.cognite.com/20230101/#section/API-versions/Beta-versionsHow do I know what date should I put into the header to gain access to the Streams beta feature?
Hi,I have been updating the beta documentation a bit since the last edition linked in the invitation. This applies to both the planned standard Cognite documentation, and the developer API documentation. All of the documents are available using a direct link to our document rendering services (linked below), and should be updated as we privately deploy new information.Note that all of these documents are works in progress with ongoing updates, so please forgive any typos, omissions, and other errors at this stage: Streams API documentation Records API documentation Capabilities for CDF Records Updated Data Modeling concepts page Concepts page for CDF Records (and Streams) Example high level use case (alarms) for CDF RecordsPlease do not share these documents.
Hi team, do you have 2-3 articles on how to get started, like a simple quick start example as a starting point to be acquainted with the service ?Thanks !FYI @Marwen TALEB
Is there a way to delete the relationship between an instance and a container? Let’s say I have a view Foo in one data model and another view FooExtension in another data model. FooExtension implements Foo.I have an instance of externalId “FOO”, space: “FOO-DAT” that have data stored in both views/containers.If it was no longer necessary to store data in container FooExtension is there a way to just delete this relationship in a way that `hasData(FooExtension)` from the DMS Query doesn’t find this instance anymore without affecting the data stored in Foo and the instance itself? Since instance count is limited, it’s becoming more common in our project modeling things having the mindset of shared instance when they mean the same thing across data models but with different formats to present the data on different Apps. But sometimes we don’t want to have the data in the app anymore and virtual deletion (boolean flags) is not always an option specially when the data volume is big.
Hello, We are a heavy users of Grafana CDF datasource. Are you planning to support alerting anytime soon? Thanks !
HiI am testing out event based triggers to see if its a good fit for a use case I am working on. When deploying the trigger the workflow is triggered many times until it has processed the whole input query, however as very many workflow executions are started at the same time, some of them will fail as the limit for running workflows has been reached.How is this handled by the trigger, will the failing workflow runs be retried? If not, is there a setting I can use to limit the amount of concurrent runs?I think this would be good both for distributing the workflow runs out and avoid the failures and also reduce the risk of failing function calls because of high load on the API.Thank you!Sebastian
Is there a way to configure a Hosted HiveMQ Extractor to extract the data into CogniteTimeSeries and not the traditional Time Series?
As illustrated in our documentation, the CDF Records feature uses a Data Modeling container as the schema definition for record data. I.e. you have to create a space and container first, before you start loading Records to a Stream. (Note: It is possible to use multiple containers together to define the schema for a single record. This may make sense in the context of, for instance, a Work Order record).However, at the moment when I write this, using the container based schema represents a somewhat confusing “limitation” when it comes to the size of a container vs the size of a record (number of properties). The way we have implemented this capability in CDF Records at the moment - using the DM containers - comes with a side-effect: The number of properties you can have for a single container is, as of right now, the same as it is in your Data Modeling service.The limits we're documenting in terms of properties for CDF Records are linked to the properties containing data within a singl
Check the
documentation
Ask the
Community
Take a look
at
Academy
Cognite
Status
Page
Contact
Cognite Support
