Community Discussions

Hi,Context:We currently organize our data in CDF using a per-country partitioning strategy, where each country has its own space.This approach was chosen primarily to restrict data access by country in a fine-grained manner.On top of that, we expose data models grouped by Business Object, such as Well Architecture, Cost Model, etc.Each Business Object model aggregates several data objects under a common business theme, which also allows us to control access by business domain in addition to country-based access.We are now planning to integrate a large amount of historical data, which will likely increase our model size by around 4x.These historical datasets are rarely queried, but we want to make sure their addition does not degrade performance for operational data — both in query latency and data ingestion throughput.We are evaluating two potential strategies: Keep everything in the same spaces, adding an indexed attribute (e.g., is_legacy = true) to distinguish legacy records. Crea

While I try to insert a Stream (using the http post as shown in the Getting Started guide), I am getting the next error:cognite.client.exceptions.CogniteAPIError: Project 2982735218914002 not enabled for Industrial Log Analytics | code: 400 | X-Request-ID: 66573df8-87ce-9b37-a837-180aee796a6c | cluster: westeurope-1 | project: slb-mmv-ops-dev This detail isn’t mentioned anywhere on the documentation. I cannot find how to change that. Can you enable ILA for https://delfi-dev.fusion.cognite.com/slb-mmv-ops-dev/?

I am stumbling through the Beta documentation. When I try to run the http post to create a Stream (as described here), I get this error:The feature can only be used with [alpha, beta] headersI found documentation that seemed relevant, but it seems the format of the header is this cdf-version: 20230101-beta https://api-docs.cognite.com/20230101/#section/API-versions/Beta-versionsHow do I know what date should I put into the header to gain access to the Streams beta feature?

Hi team,  do you have 2-3 articles on how to get started, like a simple quick start example as a starting point to be acquainted with the service ?Thanks !FYI ​@Marwen TALEB 

Hello,I’m using a Cognite MQTT Extractor.I wonder if it is possible to publish with this client to the same broker I am subscribed to.Furthermore, I would like to know if it is possible to develop callbacks in a similar way to Python clients, for example : https://pypi.org/project/paho-mqtt/#callbacks Regards,Pierre

Hi, I’m using the hosted REST extractor to populate a data model from an MES system. One of the API calls I need to make uses a URL parameter “id” to get data for production jobs by their id like: GET /scheduling/v1/jobs/{id}/operations . The production jobs are already in my data model and each has a unique id value.Is there a way to query the job ids from my data model within the hosted REST extractor so I can make a separate REST call for each job id? I was thinking the pagination feature would be the best approach, but I’m not sure how to query my data model from there to get a list of job ids to iterate through.Any insight is appreciated. Thanks!

Error when executed dbextractor.exe config.yml commandError when start the Cognite DB Extractor 3.9.0 Services 

Is there a way to delete the relationship between an instance and a container? Let’s say I have a view Foo in one data model and another view FooExtension in another data model. FooExtension implements Foo.I have an instance of externalId “FOO”, space: “FOO-DAT” that have data stored in both views/containers.If it was no longer necessary to store data in container FooExtension is there a way to just delete this relationship in a way that `hasData(FooExtension)` from the DMS Query doesn’t find this instance anymore without affecting the data stored in Foo and the instance itself? Since instance count is limited, it’s becoming more common in our project modeling things having the mindset of shared instance when they mean the same thing across data models but with different formats to present the data on different Apps. But sometimes we don’t want to have the data in the app anymore and virtual deletion (boolean flags) is not always an option specially when the data volume is big. 

Hello, We are a heavy users of Grafana CDF datasource. Are you planning to support alerting anytime soon?  Thanks !

 Below I have attached three screeshots where I query same data in same time range. I have used Queries in first screenshot, and it corresponds to original data inspected in Charts, i.e. there is no data before 4:01. This is very basic query using external id. However in many cases we need custome query where we use parametrised syntax. I have used a very basic syntax in the second screenshot that only use external id to query same timeseries as first screenshot. But the result is clearly different, there are datapoints created where there should be no data. Inspecting the datapoints in query, I see real data points with some values are created in no data area! Disabling aggregate resolve problem of creating non exiting data in third screenshot but then it query all datapoints and saturates in 2 seconds (reach max datapoints that grafana can show). So I need aggregated data and I have tried aggregate inside the syntax and same problem in scheenshot2 persists in this case. Any idea how

I checked the Data Management UI in CDF Fusion. There is a list of data models in the PublicData project.There, I found the Cognite Core Data Model, where the schema is well-defined, but the instance has no data.I want to explore a GraphQL query using this data model—for assets with their hierarchy and related entities such as time series and files.However, since there is no data, I am not sure how to proceed. Could you please guide me on how to solve this?if we need transform data we need permission for the write  

Hi Canvas Team -  Do we have the ability to make a public canvas that has the ability for the owners to lock & unlock it (making it essentially read only)?  Examples of this will include the ability to save a work package, turnaround package, reliability root-cause analysis, etx that others can see in the future however they can’t edit. The owners (people specifically shared) have the ability to unlock and edit it.   Other scenarios are a read-only version of the canvas for other people that are not the owner. 

We have outage on Cognite function deployments impacting both Development and UAT environment at PSaas cluster at ADNOC environment.Please refer the below url for the respective env.https://adnoc.fusion.cognite.com/sub-cgnt-panorama-dev/https://adnoc.fusion.cognite.com/sub-cgnt-panorama-uat/This is impacting on our development and UAT testing.kindly do needful asap.Thanks,Palaksha

Workflow to Connect Power BI to FT DataMosaixI am currently experiencing issues connecting Power BI to FT DataMosaix for the project ai200prodtesting-44-datamosaix. I would like to highlight that for the essc-sandbox-44 project, the connection works as expected, as shown in the evidence below.Below is the step-by-step procedure I followed to connect to the ai200prodtesting-44 project:Steps:1. Select Get Data > Cognite Data Fusion (REST API) connector.2. Set up CDF Project and CDF Organization.3. Choose Sign in as a different user.4. Enter user email address.5. Enter user password.6. Click Connect.7. Review the error message: Unable to connect. the message with the error "Unable to connect" attached.

Instead of storing String data as timeseries, we would like to store data in Staging and then transform to Events with addition metadata.Can the existing OPCUA extractor support that?

HiI am testing out event based triggers to see if its a good fit for a use case I am working on. When deploying the trigger the workflow is triggered many times until it has processed the whole input query, however as very many workflow executions are started at the same time, some of them will fail as the limit for running workflows has been reached.How is this handled by the trigger, will the failing workflow runs be retried? If not, is there a setting I can use to limit the amount of concurrent runs?I think this would be good both for distributing the workflow runs out and avoid the failures and also reduce the risk of failing function calls because of high load on the API.Thank you!Sebastian

Is there a way to configure a Hosted HiveMQ Extractor to extract the data into CogniteTimeSeries and not the traditional Time Series?

Sideways scrolling is really cumbersome, why have you made the UI significantly worse? 

Hi,I want to set up monitoring of timeseries wrt reservoir levels. Yesterday I also set up a dummy monitoring, simply to test the functionality. I set the monitoring to alert when timeseries is over 1462.88 meters, which was crossed yesterday evening, but no alarms were triggered.Please see screenshot of my setup below, does this seem right? BR,Jørgen Aarstad  

Interested in understanding cognite product line, how it is used with industrial automation and IoT system, Very much interested in how GenAI has been integrated. 

This is sample codehow can i give custom input to this python code # Note that the docstring is how the agent knows how to call the function. It follows the Google Python Style Guide:# https://google.github.io/styleguide/pyguide.html#383-functions-and-methods from cognite.client import CogniteClientfrom cognite.client.data_classes.data_modeling import NodeIdfrom cognite.client.data_classes.data_modeling.cdm.v1 import CogniteTimeSeries client = CogniteClient() # Retrieve latest data point by time series node iddef handle(time_series_id: NodeId):    """    Retrieves the latest data point for a given time series.       Args:        time_series_id: The node id of the time series to retrieve the latest data point for.       Returns:        The latest data point for the given time series.    """    datapoint = client.time_series.data.retrieve_latest(instance_id=time_series_id)       # Only json serializable data is supported, so we convert the created_data to a dict with .dump().    return d

When running the following lines of code I get an error with Pydantic:from cognite.neat import NeatSessionneat = NeatSession(client)The error is as follows:---------------------------------------------------------------------------ImportError Traceback (most recent call last)Cell In[13], line 1----> 1 from cognite.neat import NeatSession 2 neat = NeatSession(client)File ~\AppData\Local\Programs\Python\Python311\Lib\site-packages\cognite\neat\__init__.py:4 1 from cognite.neat.core._utils.auth import get_cognite_client 3 from ._version import __version__----> 4 from .session import NeatSession 6 __all__ = ["NeatSession", "__version__", "get_cognite_client"]File ~\AppData\Local\Programs\Python\Python311\Lib\site-packages\cognite\neat\session\__init__.py:1----> 1 from ._base import NeatSession 3 __all__ = ["NeatSession"]File ~\AppData\Local\Programs\Python\Python311\Lib\site-packages\cognite\neat\session\_base.py:9 7 from

Hi Team, We are planning to create Business Continuity and Disaster Recovery document for CDF in our environment and using https://docs.cognite.com/cdf/trust/security/reliability_intro/ But, we are missing some information regarding the RTO and RPO for different scenarios,Full cluster restore  CDF project restoreCould you please help us on this.ThanksAbhra

Hello,  We recently migrating the way of deployment of Streamlit App in our cdf toolkit project. Before we used to deploy our streamlit app by creating a file in a dedicated dataset. Now we use out of box way of deploying Streamlit Apps provided by cdf toolkit  (this was not available before).  When changing to this way, we notice that the app is only deployed using “--include streamlit” option.i.e: when not using the “--include streamlit” cdf toolkit the deploy summary is the following:    however, we notice it is a previous version that has been deployed!  when using “--include streamlit”: summary is the following And the App latest version is deployed as expected. Toolkit Version used is '0.6.20'. Are we missing something? Could you please take a look at this?  Thanks!      

app.cognite.service: Found 1 data modelIn the publicdatacdm space, only one data model is currently available, which is related to 3D scenes.However, our goal is to create a knowledge graph, which requires asset-related data models. Since the available model is focused on 3D scene configuration, it doesn't cover the necessary asset relationships.To move forward with building a knowledge graph, we need: Asset-centric data models. A clustering mechanism to visualize and structure the knowledge graph meaningfully. Is there any plan to include asset-related models in publicdatacdm, or any recommended approach to achieve this with the current setup?