Skip to main content

Product User Community

Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 1,049 Topics
  • 3,358 Replies
1050 Topics
S
Seasoned
Sonali Vishal PatilSeasoned
asked in Product User Community
What is the maximum numbers of the rows supported in cognite staging tables

What is the maximum numbers of the rows supported in cognite staging tables

122
Andre Alves
MVP
D
Active
duncan.murrayActive
asked in Product User Community
Sync API does not pull changes to data

Hi, I have been trying to use the sync API to try and pull changes from a data model - specifically node instances from a view. When testing, some fields within a view was changed / updated but I was not able to pull anything new using the sync API. This was after I created a baseline of the full dataset using the Query endpoint. The sync endpoint did work when new nodes were added to the view, it would only pull the new row, so I think my query is correct. Is there some sort of parameter to turn on / other way to use the sync API to retrieve changes and new additions to instances?

1015
Arild Eide
Seasoned Practitioner
R
Seasoned
Rimmi AnandSeasoned
posted in Product User Community
Dynamic Tasks processing in sequence

I have created 1 workflow , in which I am creating dynamic tasks depending on input, it creates batch of ids and create tasks out of it. Below is workflow definition WorkflowVersionUpsert( workflow_external_id="test_dynamic-0729", version="1", workflow_definition=WorkflowDefinitionUpsert( description="This workflow has two steps", tasks=[ WorkflowTask( external_id="test_sub_tasks", parameters=FunctionTaskParameters( external_id="test_sub_tasks", data="${workflow.input}" ), retries=1, timeout=3600, depends_on=[], on_failure = "abortWorkflow", ), WorkflowTask( external_id="test_create_sub", parameters=DynamicTaskParameters( tasks="${test_sub_tasks.output.response.tasks}" ), name="Dynamic Task", description="Executes a list of workflow tasks for subscription creation", retries=0, timeout=3600, depends_on=["test_sub_tasks"], on_failure = "abortWorkflow", ) ] ) As part of this workflow, I have some task that are needed to be executed in parallel and are expected to finish in around similar

29529
N
Seasoned
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Product User Community
Transformation Failure

Reporting as requested. The system seems very unresponsive SQL Transformations internal error. Please report this error to Cognite. Query job ID: a3b2004a-0b5f-4e43-82bd-c396c3bf1a7d | code: 400 | X-Request-ID: 2dd10804-d4c6-9cce-b35c-a1b8af8574c1

181
Mithila Jayalath
Seasoned Practitioner
C
Active
carriechungActive
asked in Product User Community
Early Adopter of DirectQuery in Power BI

Hi, As mentioned below, which group to sign up for early adopters of DirectQuery in Power BI? https://docs.cognite.com/cdf/dashboards/guides/powerbi/dq_why I can’t find relevant group from what I see from here https://hub.cognite.com/groups Any tips ? :) Thanks,

985
I
MVP
Peter Quinn
Committed
Peter QuinnCommitted
asked in Product User Community
Is there a InfluxDB extractor?

We have customers using InfluxDB as a local on-prem storage mechanism. What’s the best extractor to use to push this data to CDF? I’ve heard OPC-UA is the way to do it, but what I find online are ways to store OPC-UA data into Influx, but not ways to get InfluxDB data into a OPC-UA server so I could use the OPC-UA extractor to get it into CDF.

1195
Taylor Zwick
Practitioner
E
Active
Ethelbert DerigeActive
asked in Product User Community
Applying textures to 3D model imports

Our team is handling 3D models in various file formats and applying colors to different models before importing them into CDF. Additionally, we are applying textures to models using Navisworks Simulate and exporting them in .nwd or .fbx formats. All related files are zipped before uploading them in CDF. According to the Cognite 3D documentation, this should be possible. However, when we import the models, the colors do not appear as expected. Could you provide guidance on the correct procedure to ensure that colors and textures are retained? Is there a specific workflow or setting we should follow?

685
G
Practitioner
Everton Colling
Seasoned Practitioner
Everton CollingSeasoned Practitioner
posted in Product User Community
Microsoft-Certified Power BI REST Connector Now Available!

The new CDF Power BI REST connector has been certified by Microsoft and is now included in the latest Power BI desktop version and deployed in the Power BI online service.What's new with the Power BI REST connector: Flexible authentication: Connect Power BI with any IdP supported by CDF (the legacy OData connector only worked with Azure Entra ID) Broader data access: Fetch data from OData services (just like the legacy connector) Access data from Data Models using GraphQL Connect to any GA CDF API endpoint Significant performance boost: Up to 10x faster when using regular REST endpoints compared to fetching the same data via OData The connector is currently in Beta, and we're eager to hear customer feedback before promoting it to GA. The documentation for the new connector is available here, and we're working on a new set of micro learning modules in Academy based on the new connector.

11010
Andre Alves
MVP
A
Committed
Alex NarayananCommitted
asked in Product User Community
Support for DFOS (Distributed Fiber Optic Sensing data

Hi Just wondering if CDF extractors/connectors has a support to fetch DFOS data, say for example to measure temperature along the line. Access may perhaps be through the third party SDK or a native connector. Also interesting would be how such high frequency data can be modelled in CDF core and solution models correctly. Any pointers would be of great help! Regards Alex

111
T
Seasoned Practitioner
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Product User Community
Canvas Data Grid Issues

The data grid object has some issues when changing the grid like removing a row or adding a column etc. The attached video shows the behavior. A browser refresh clears up the “jitter” but changes do not take effect.

270
Chris Selph
Seasoned
M
Seasoned
Marwen TALEBSeasoned
asked in Product User Community
Access granularity per space on data models level is not working

Hello, While testing data gouvernance feature per space in the data model service, we noticed that it does work on the instance level but not on the data models level. Here are the tests conducted: Test 1: We tested giving access to users to only instances that are in a specific space but applying the following ACL : - dataModelInstancesAcl: actions: - READ scope: spaceIdScope: { spaceIds: ['test'] } When requesting the data model, only instances in the test space are returned. ACL works on instance level. Perfect! Test 2: When applying a similar ACL on the data model level : - dataModelsAcl: actions: - READ scope: spaceIdScope: { spaceIds: ['not_that_important_data_models'] } In this case, we notice that we get revoked access to all data models, even data model in not_that_important_data_models space. We expected that we would be able to access only data models in not_that_important_data_models. Could you please check ? Thanks

141
M
Seasoned
E
Active
Erik WikerActive
asked in Product User Community
Cascading delete of instance

Hi! Is there a way to enable cascading deletes for instances for both direct relations and edges? Edit: I posted in the wrong group, but i don’t think i can delete.

513
J
Active
C
Active
Catharina SilveiraActive
asked in Product User Community
How to connect public data on Power BI?

I would like to know what to fill in BI to be able to connect on CDF. I tried to use that how on the course, but gives a error to add the organization name. publicdata?tenantID=48d5043c-cf70-4c49-881c-c638f5796997

101
Everton Colling
Seasoned Practitioner
M
Seasoned
Marwen TALEBSeasoned
asked in Product User Community
CDF Spark datasource is broken from version

Hello, I’m having this error while using CDF latest Spark datasource. I was only able to make it work using 2.1.10 version (com.cognite.spark.datasource:cdf-spark-datasource_2.12:2.1.10). Could you please take a look? Thank you !

396
J
Practitioner
mkraemer
Committed
mkraemerCommitted
asked in Product User Community
Cognite Academy Fundamentals : Working With CDF: Contextualize "No matches found"

In Cognite Academy Fundamentals : Working With CDF: Contextualize, I have followed all of the instructions several times for Entity Matching and, in all instances, get “No matches found”, so there is nothing to confirm or write to CDF. What am I missing here?

425
mkraemer
Committed
R
Committed
Richard LaiCommitted
asked in Product User Community
local file extractor configuration yaml environment variable setup

I am new bee for this mammal, to Setup the Cognite file extractor for the local file upload to CDF, how to I config the environment variable in the yaml?according to the example-local.yaml I need to read:COGNITE_BASE_URLCOGNITE_PROJECTCOGNITE_CLIENT_IDCOGNITE_TOKEN_URLCOGNITE_CLIENT_SECRET I am little confuse, should I create a .env file to have all of those environment variables in that file and put it in the same folder as the yaml config file or can I inject those variables in the configuration file itself, if so any example? need someone lighting me up.

364
T
Seasoned Practitioner
A
Seasoned
Ali-AkramSeasoned
asked in Product User Community
Extractor-utils Library for Cognite Python SDK Step 1: Start a new project

it says that the project is not valid and do not give me the hello world output.

355
Mithila Jayalath
Seasoned Practitioner
A
Seasoned
Ali-AkramSeasoned
asked in Product User Community
got 401 "Unauthorized" error when using Postman and also sometimes a bad request error

got 401 "Unauthorized" error when using Postman and also sometimes a bad request error while I did everything as they did in the course. please help it took a lot of time from me.

334
A
Seasoned
L
Committed
Lok Mun SohCommitted
asked in Product User Community
OPCUA | Create event from Data node

How can we configure the OPCUA data node (in string) as event in Cognite instead of timeseries (by default)?P.S. The existing OPCUA Server does not support to configure it as Event.

173
E
Practitioner
S
Committed
Satyam AnandCommitted
asked in Product User Community
Incremental Load in Hosted Cognite Rest extractor

I m working cognite hosted rest extractor and i m not able to perform incremental load and getting Kuiper http error while making a request. Can someone explain what the key name is when we use query params for incremental load and how should value look like in json having a conditional statement to pick a constant value in first execution and last_run from context after that? (Assume we have to modify startindex and lastindex query params after first excution)

307
E
Practitioner
A
Seasoned
Ali-AkramSeasoned
asked in Product User Community
Learn to Use the Cognite Python SDK in the data engineer course

so in the Learn to Use the Cognite Python SDK in the data engineer course , I got stuck on the hands on test.as in the readme file after I created a dataset and a root assets I just do not know how can I do this section : - Read the `all_countries.csv` file as a dataframe and list all the unique regions in the world. - For each geographical region, create a corresponding CDF asset that is under the "global" root asset and is associated with the "world_info" data set. - Next, create country-level assets using the data from the CSV and link them to their corresponding region-level assets.

202
A
Seasoned
S
Committed
sebastianheibo.aksoCommitted
asked in Product User Community
Reading edge relation from data model view through Python SDK

I have a data model with a many to many relation between view 1 and view 2. This is modeled as an edge and stored as columnEdgeView2 in view 1 and has an edge pointing the other direction in the other view. I have been digging through the Python SDK documentation but cannot figure out how to retrieve this information. Can anyone help me with this? What I need to do is query either of the edge properties and do something similar to the instance.list of regular views. If possible, getting the columnEdgeView2 included in the result when listing instances the normal way would also work. I have tried to replicate my data model structure below. type View1 { column1: String columnEdgeView2: [View2]} type View2 { column1: String columnEdgeView1: [View1] @relation( type: { space: "space", externalId: "View1.columnEdgeView2" } direction: INWARDS )} Thank you!

130
S
Committed
B
Active
Barbara BarzyckaActive
asked in Product User Community
Full Data Model with mutliple connections

Hello, we're using pygen to generate a Full Data Model and instances. One of our containers can have multiple connections to objects in another container (see the pic below). As a result, definitions are lists of objects. It is then difficult to query data using tuples: bays = dm_client.bay.list( bay_to_line=(space, id), retrieve_connections="identifier", limit=None, ).to_pandas() We can overcome this by reading all bays with retreive_connections=”full” and then querying the data. But we would like to generate a model, where such tricks are not needed and the definitions are not a list. Is it possible? To generate a model we do this workflow: neat.read.rdf("lines_bays.jsonld")neat.infer(max_number_of_instance=-1)neat.prepare.data_model.cdf_compliant_external_ids()neat.verify()neat.convert("dms")neat.set.data_model_id(("lin", "lines", "v1"))neat.to.cdf.data_model()neat.to.cdf.instances()

161
Anders Albert
Seasoned Practitioner
M
Seasoned
Marwen TALEBSeasoned
asked in Product User Community
Having different results using different method of SDK generated by Pygen

Hello, We are currently the Pygen (cognite-pygen==1.0.2) to generate an SDK of our data model. While testing a use case where we want to query all Casings of all Onshore Wells we notice that we get different results using the `List` and `Select` methods. # First method of querying wells = dm_client.well.list(product_line='Onshore', retrieve_connections='identifier',limit=-1)direct_relations = []for w in wells: if w.wellbores: for wb in w.wellbores: wb_ext=wb.external_id inst = dm.DirectRelationReference(wb.space, wb_ext) direct_relations.append(inst)wb_sections = dm_client.wellbore_section.list(wellbore=direct_relations, retrieve_connections='full', limit=-1)casings = wb_sections.casingprint(f'casings: {len(casings)}') # casings: 645 # Second method of querying casings= dm_client.well.select().product_line.equals('Onshore').wellbores.wellbore_sections.casing.list_casing(limit=-1)print(f'casings: {len(casings)}') # casings: 94 Any thing we missing here? Could you please take a look? Tha

212
Anders Albert
Seasoned Practitioner
Andrew Wagner
Committed
Andrew WagnerCommitted
posted in Product User Community
Cognite as Historian

Is anyone using Cognite as their main timeseries historian? We are always exploring alternatives and would be interested to hear if Cognite has fit this use case for any users.

100
Andrew Wagner
Committed
Terms & ConditionsCookie Settings

Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings