Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
HiI am developing a data model that will contain a single view with many properties (approx. 150). The number of properties will probably also increase over time. To model this, I have tried splitting the data in two containers and mapping the properties in the view to both containers. However, now that I am testing it I am experiencing performance issues. I have now tested the model with 3 million instances and all queries time out.I am therefore wondering if there are any recommended/tested approaches for dealing with wide tables in data modeling that will make it more efficient.The data model mostly contains normal properties (string, float, int) and 4 direct relation properties. I have created three indexes on one of the containers on properties that I need to filter on in queries.In addition, the view implements the CogniteDescribable and CogniteSourceable concepts from the core model.Thank you!
We are working on making our contextualization efforts more efficient. One of our key initiatives is to extract all tags from P&IDs to build a clean dataset that we can then match against asset hierarchies, helping us identify gaps on both sides. Additionally, we aim to minimize the need to revisit P&IDs whenever new patterns emerge that don’t align with the current contextualization process.For our initial approach, we tested extracting all tags from P&IDs to create a comprehensive list. We are aware that Cognite provides an API feature to extract tags based on predefined entity patterns. However, we are looking for a solution that allows us to extract all tags—without requiring predefined patterns.We have tested multimodal LLMs for this purpose, and they have shown promising results. Our questions are:Does Cognite offer any built-in functionality that supports extracting all tags from P&IDs without predefined patterns? If not, is there a cost-efficient approach to ach
The question came up around succession planning.So, if we have a user that has created a lot of Charts or Canvas’s what happens to those when that user is longer a part of the Cognite project/our company? The answer that we got from our Cognite project team is that these are orphaned. Do we have a way to re-assign them to another user? I am just looking to see if we have a better way to handle this process so that we don’t lose any of the work that has been put into the Canvas or the Charts.
I want to upload instances using CDF Toolkit. For example, data model I can get dump yaml from existing data model using toolkit like following:cdf dump datamodelI want to get the dump yaml of instances from my existing space and data model which I can use it to later deploy using toolkit to different space or env. I checked the doc here: https://docs.cognite.com/cdf/deploy/cdf_toolkit/references/resource_library#nodesBut creating yaml file manually would be too hard. I have also tried to get dump yaml using python sdk but that dump yaml looks incomplete to be used for deployment.
I figured out how to add a slider to my Chart, but how do I move or delete it?
In order to identify a 3D model and revision both a model ID and revision ID are needed (e.g. for display in Reveal). Looking at the Core Data Model, I can see the revision ID is available in CogniteCADRevision, but I don’t see where the model ID is present (was expecting it in CogniteCADModel).
We wanted to use view filter to implement a new view in a datamodel with a subset of data. we wanted to filter on a property with external id “WELL” we tried this in a few models, and we get only 70 instances, but when we try to query instances with same filter in transformations sql query, graphql query or rest api endpoint for filtering instances we get 71.even in data modeling ui, when same filter is applied on original model, it shows 71 instances but one fo them shows up as empty UPDATE:the one that was missing in data model UI is because that well instance doesn’t exist in that space (only 70 wella in that right space). but when we query the same data model instances from rest api , it gives that well from different space as well (71 wells). it gives well instance along with WELL type from other space which actually does not exist
I am trying to deploy a function to CDF using the deploy-functions-oidc repo in Github. It works perfectly fine for other functions, but for functions using the “requests” library i get the following error during pre-commit: “Library stubs not installed for requests. Hint: “python3 -m pip install types-requests”. I have included both requests and types-requests in the requirement.txt file. Anyone experienced the same issue?
I want to use node JS express as my back server to get data from cognite refer to theirhttps://developer.cognite.com/sdks/js/for the backend:import { ConfidentialClientApplication } from "@azure/msal-node";import { CogniteClient } from "@cognite/sdk";async function quickstart() { const pca = new ConfidentialClientApplication({ auth: { clientId: 'YOUR CLIENT ID', clientSecret: 'YOUR CLIENT SECRET', authority: 'INSERT AUTHORITY HERE' } }); async function getToken() { var response = await pca.acquireTokenByClientCredential({ scopes: ['INSERT SCOPE HERE'], skipCache: true, }); return response.accessToken; } const client = new CogniteClient({ appId: 'Cognite SDK samples', baseUrl: 'YOUR BASE URL', project: 'YOUR CDF PROJECT NAME', getToken: getToken }); const assets = await client.assets.list(); console.log(assets);}quickstart();What is the authority and how can I find my authority?
Lets say I have 3 views called myAssetType & myAssetLocation & myAssetProduct. All the 3 views implement CogniteDescribable from CDM.The view myAssetProduct also has an additional property called asset. Next, we ingest data into all the 3 views as shown below.View - myAssetTypeexternalId name descriptionMotorId Motor A motorView - myAssetLocationexternalId name descriptionLocationId OfficeA Location of the officeView - myAssetProductexternalId name description assetProductId Water Water from motor MotorOnce the data is ingested as above, we should ideally only see specific data in these views, but the data shown in these views are as follows:View - myAssetTypeexternalId name descriptionMotorId Motor A motorLocationId OfficeA Location of the officeProductId Water Water from motorView - myAssetLocationexternalId name descriptionMotorId Motor A motorLocationId OfficeA
Hi, I was wondering if it is possible to update an outdated old 3d model with 360 laser scan images. The original model from when plant was build was corrupted and now we have only parts. I think this would help maintenance enormously, the images are now in faro sphere, which is not the easiest to navigate around
Hello:Is it possible to use the CDF API with RapidAPI or Thunder Client? If so, could you please give me an example?
I am trying to setup an asset hierarchy using the Core Data Model as shown in the example:https://docs.cognite.com/cdf/dm/dm_guides/dm_cdm_build_asset_hierarchy/But I am getting some strange errors when I try to implement it. A normal container and view without a refernce to core data model works fines, but when trying to add cdm it fails. I am using the toolkit to deploy the data model.In the “Data management” tab I get this error:{ "title": "", "message": "Cannot read properties of undefined (reading 'listPump')", "errors": []}In the “Query explorer” I get these errors:{ "errors": [ { "message": "The field type 'Cognite3DObject' is not present when resolving type 'Pump' [@-1:-1]", "locations": [], "extensions": { "classification": "ValidationError" } }, { "message": "The field type 'CogniteSourceSystem' is not present when resolving type 'Pump' [@-1:-1]", "locations": [], "extensions": { "classification": "ValidationError"
I am using the Hosted Kafka Extractor and need to subscribe to multiple topics with specific filters. To do this, I plan to create multiple jobs under one connection. I have a few questions:What is the maximum number of jobs that can be created in a single connection? How many hosted extractors can be created in a Cognite project? Does the Hosted Kafka Extractor support wildcard characters for topic subscriptions?I checked the Hosted Extractors and Kafka Extractor documentation, but I couldn't find clear limits on job or extractor counts. Also, the Kafka Extractor job seems to subscribe to a single topic at a time, so I'm unsure if wildcards are supported.Could someone clarify these limits and wildcard support?
need to reset my MFA as my old phone is damaged
When I bring my chart into the canvas, the calculated values are not showing. I’m likely just missing a setting, but cannot figure it out. Hope someone can help me. Thanks.
Hi guys! We are developing a Power BI dashboard that relies on time series and sequences fetched from CDF using the Cognite Extractor. We have set up a deployment pipeline for our dashboards (Dev, Test, and Prod), where each environment in the PBI pipeline corresponds to data sources in the respective CDF tenant. I.e., our Dev dashboard reads data from our dev tenant in CDF, and so on. We get this to work by configuring a Parameter in Power BI desktop with values that match our CDF tenants.Then we refer to these parameters when we define the data sources. Here is an example of how we use push-down filtering via OData queries from the Advanced Editor in Power Query:Source = Cognite.Contents(cdf_env & "/Timeseries/?$filter=ExternalId eq 'our_special_external_id'", null),The variable “cdf_env” evaluates by default to Dev, and we have configured the deployment pipeline such that this parameter updates automatically when we deploy from Dev to Test, and from Test to Prod. But here is the
Hello,I’m having trouble sharing a Jupyter notebook on Cognite. I used the right-click option to copy the shareable link, but when I or others click on the link, we encounter a 404 error like the following: Has anyone else experienced this issue? Also, they can’t find the notebook going to the folder, only myself can see it.Thanks!
I am seeing how to create Templates used to query data, but I have not yet found information related to defining GraphQL mutations. Do you know where I can find this information? Thanks! Here are some places I’ve been looking.Docs:Templates | Cognite DocumentationAbout template management | Cognite DocumentationSearch results for "templates" | Cognite DocumentationThe tests in the Python SDK:https://github.com/cognitedata/cognite-sdk-python/blob/master/tests/tests_integration/test_api/test_templates.py There is some info related to GraphQL mutations and Cognite here, but this doesn’t seem related to Cognite’s Template functionality:https://itg.cognite.ai/docs/tutorials/data-ingestion/ingesting-datahttps://github.com/cognitedata/sample-cdf-graphql-angular-app/blob/9641e4967e0a288241ef68b3e94786b56de456c2/src/app/itg-api.service.ts#L125
Hello,There’s a number of Functions that used to work as expected but now fail to be executed correctly on their set schedules on a CDF project. The .zip files associated with the files are not present. Is there a relation between these functions failing and the absence of the .zip files under the Data Explorer tab?Thanks,Marwan
I’ve encountered a bit of an interesting issue when converting annotated P&IDs to SVG files using this endpoint from the Python SDK:cognite_client.diagrams.convert(diagram_detect_results)If I send in one file at a time then it works as expected:But if I try to upload convert them at the same time then the annotations switch over for some reason. The annotation mapped to file_1 are shown on file_2 and vice versa. This also scales, but is a lot easier to demonstrate with just two files: I’ve attached the diagram detect results that I send in to the API, and I can’t see any reason why this would happen. This makes parallelization somewhat difficult as we need to convert each file individually to ensure correctness.Attachments:daigram_res.txt contains both files at oncedaigram_res_1.txt and diagram_res_2.txt contains each file as separate entities
The December release added tabs for directly & indirectly linked data. I am having trouble finding documentation that explains the difference between the two.
I noticed when you're looking at a large time frame, the threshold feature on Charts only looks at the aggregated values, not the raw or even min/max values. Is this the same with the data profiler and monitoring jobs?
Hi,In order to deal with manual annotations as an additional step on top of our automated process we have created two access groups; a suggester and a reviewer group. What we were expecting was that when a suggester added an annotation that it would be listed as a suggestion, but it seems that all annotations that are added manually are automatically approved.Is there a way to inverse this, so that all manual annotations regardless of the users access are “suggested” and not “approved”, the ones who suggest are not necessarily the ones that approve. We would like all annotations done manually through the Fusion UI Data explorer to be suggestions on creation. Regards,Markus PettersenAker BP - Data Delivery
HelloWe have Flexible model which has Entity view and then a property named parent refers to Entity back as an edge. Now our user sends us an query to get all the entities say whose name is “SomeString”. And then we construct a query as below, but it errors out.{ "with": { "Entity": { "nodes": { "filter": { "and": [ { "matchAll": {} }, { "hasData": [ { "type": "view", "space": "slb-pdm-dm-governed", "externalId": "Entity", "version": "1_7" } ]}, {"or": [ { "and": [ { "nested": { "scope": [ "slb-pdm-dm-governed", "Entity/1_7", "parent" ], "filter": { "in