Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 556 Topics
  • 1,777 Replies

556 Topics

K
Seasoned
Kristian NymoenSeasoned
posted in Developer and User Community

Monitoring CDF operations

Hi! We’re aiming to monitor all of our CDF operations in the solution we have for monitoring other systems and data flows (Splunk). This would involve monitoring of extractors/extraction pipelines, cognite functions, and general platform availability. I wonder if any other Cognite customers have done this, and if you would be willing to share your experience / architecture for extracting logs from cognite functions etc. into Splunk or a similar service? Cheers,Kristian 

0
K
Seasoned
15 hours ago
T
tabdoolNew
asked in Developer and User Community

Synthetic time series query not supporting IF statements in 'expressions' parameter

I am trying to create a synthetic time series query that looks are two other time series and if those values meet a certain condition, is outputs a 1 or 0 as the synthetic time series but I keep getting a syntax error that I can’t solve. Below is a code sample. temp_id_list = [3308928194658464]flow_id_list = [1256034258207391, 3564715377369546]for temperature in temp_id_list:    temp_expression = f"TS{{id:{temperature}}} < 200"    flow_expression = " + ".join([f"(TS{{id:{flowrate}}})" for flowrate in flow_id_list])    final_expression = f"if({temp_expression} and {flow_expression} > 0, 1, 0)"    cv_query = client.time_series.data.synthetic.query(expressions=final_expression, start="1d-ago", end="now")

2
M
Practitioner
18 hours ago
A
Active
aravindActive
asked in Developer and User Community

Reg. 3d model and programatic interaction

I am looking for information related to 3d models. I would like to explore does reveal/cognite supports programmatic change of animation on 3d models which are uploaded to cdf. What i am looking for is, i have 3d model of pump and would like to change the animation speed depending on the speed i get from my api (basically real time speed which i get from my api). Does it possible ? If so could you guide me to example code to how to do that. Also the uploaded 3d model in cdf is not displaying like how the original model that was uploaded. After uploading into cdf its not displaying with colors and animations, could you tell me why it is like that ? Thanks 

1
H
Practitioner
16 hours ago
S
Shreya PandeyNew
asked in Developer and User Community

Cognite Machine learning

How can I use Machine Learning Models inside Cognite data fusion?

0
S
4 days ago
H
Hakim AREZKINew
asked in Developer and User Community

Testing CogniteAuthError with monkeypatch_cognite_client

Hello, is it possible to test the  CogniteAuthError using monkeypatch context manager  ?Regards ,Hakim Arezki 

0
H
7 days ago
A
Active
andcondallActive
asked in Developer and User Community

Generate client from CDF openapi spec for Go

I am unable to generate client code for the CDF openapi spec at https://api-docs.cognite.com/20230101/ using deepmap/oapi-codegen for Go, seemingly because the spec contains some errors. Do anyone know of a way to generate an api-client in go for the CDF-api spec? Both commands below rely on having openapi spec downloaded to the current directory from https://api-docs.cognite.com/20230101/ Testing the spec for errors with redocly/cli: docker run --rm -it -v $PWD/swagger.json:/swagger.json redocly/cli lint /swagger.jsonFor me this results in “Validation failed with 25 errors and 382 warnings” Generating the client library using deepmap/oapi-codegen: go run github.com/deepmap/oapi-codegen/v2/cmd/oapi-codegen@v2.0.0 --config oapi-codegen-config.yaml swagger.jsonwith the this config file:package: "cdf_api"output: "cdf_api.gen.go"generate: models: true client: truecompatibility: circular-reference-limit: 100For me this results in the message “error generating code: error creating operat

0
A
Active
7 days ago
N
Committed
Neerajkumar BhatewaraSchlumberger
asked in Developer and User Community

OPC UA Extractor - is there a parameter to handle the source timezone similar to DB Extractor

Hello,In DB Extractor, I see a parameter that could be configured to specify how to treat the timezone parameter.  Is there something similar for OPC-UA Extractor as well ?If not how can the different timezone data could be handled or atleast Local timezone data ?

3
E
Practitioner
2 days ago
A
Active
andcondallActive
asked in Developer and User Community

Download openapi spec in CI

Trying to download the openapi spec over at https://api-docs.cognite.com/20230101/ by using the URL in the “download” link fails with 404 when trying to use the URL with wget/curl and “ADD” in a dockerfile. It seems like the link is generated behind the scenes during pageload by javascript. Is there a way to download the openapi spec in scripts e.g for use in CI pipelines and similar?

2
A
Active
7 days ago
G
Active
gghalebActive
asked in Developer and User Community

state for OPC-UA extractor

Hi There,How do you configure the state of OPC-UA extractor in the Raw layer?I know that you can do it through various types of state stores including InfluxDB or local, but I have a dataset and a table in the Staging area which I would like to get populated.Thanks in advance!

2
G
Active
8 days ago
S
Shabnam OghbaieNew
asked in Developer and User Community

OPC UA extractor connection to CDF fails

I have provided the essential credentials within the config.yml file in the OpcUaExtractor config folder, however when run it get this error. How can I fix this?

1
D
Practitioner
10 days ago
S
Shabnam OghbaieNew
asked in Developer and User Community

build automated pipeline to create and upload 3D model

Looking at API documentationhttps://pr-411.docs.preview.cogniteapp.com/api/v1/it seems one can not build an automated pipeline to create and update 3D model only using python SDKs?I aim to make a pipeline using cognite function and python sdk for nightly update reading files from SharePoint and upload or update 3d models in cdf.If its possible, where I can find the guiding document?

0
S
17 days ago
R
rmawais791New
asked in Developer and User Community

CDF Data Points Benchmarks with OBDC and OPC UA to read data from other application

Hi I have an application to read data from and I have two options either to use ODBC or OPC UA directlyWhat are the benchmarks or limitations when it comes to aboveI have 30,000 data points to read with sample time of 1s and 5s and 10s 

2
D
Practitioner
7 days ago
R
rmawais791New
asked in Developer and User Community

CDF Data Points Benchmarks with OBDC and OPC UA

Hi I have an application to read data from and I have two options either to use ODBC or OPC UA directlyWhat are the benchmarks or limitations when it comes to aboveI have 30,000 data points to read with sample time of 1s and 5s and 10s 

1
D
Practitioner
16 days ago
G
grc5084New
asked in Developer and User Community

Issue Running Transformation to get data into CDF

Hello, I am going through Cognite Data Fusion Fundamentals and am having an issue that I cant figure out. After multiple attempts I am loading 1 row of data to try and figure out my issue.I make it to the “Preview the Transformation” step:  The next step is to “Run the Transformation” step and this is where I am running into an issue. I get the below error message and theres no suggestion on what to do to correct my apparent error. Any idea what to do or how to progress? I just want to finish this course. -George

2
D
Practitioner
7 days ago
K
Active
Karguvel kalisekarActive
asked in Developer and User Community

Python SDK - List, Search, Query Instance from FDM

Hi Team,Is there any sample code available for retrieving a list of instance objects from FDM? I've reviewed the documentation's sample code, but I need additional clarification on where to provide Space, Object Type, Version, and Data Model.  Sample code available for Instance List. instance_list = c.data_modeling.instances.list(limit=5) I have also followed the steps outlined in the document URL below.. advancedListInstance queryContent searchInstances Thanks,Karguvel K

3
K
Active
7 days ago
R
Rajas AthaleNew
asked in Developer and User Community

Does CDF support timeseries ingestion with non numeric values

Does CDF support the direct ingestion of timeseries with non-numeric values ( enums).  If the workaround is to convert enums to integers to ingest, this is unnecessary overhead and a limitation. Also have to remember to convert the values back for visualization. 

2
Glen Sykes
Practitioner
20 days ago
Chris Selph
Seasoned
Chris SelphSeasoned
asked in Developer and User Community

Cognite DB Extractor 3.0.0 Stops After Execution

Running Cognite DB Extractor 3.0.0 as a Windows Service. Note that previous versions of this extractor have worked fine although some changes have been made to the config.yml since upgrading. Symptoms - According to the log, Upon starting the service, It seems the extractor will run and successfully query and upload (30 rows in this case) and then the service will STOP running immediately as indicated in the Windows Services app.There is an error in the log file about database/table already existing which does not make sense to me b/c usually errors will prevent the service from starting at all.  https://www.yamllint.com/ indicates the config.yml is valid. The only entry in Windows Application log is an “Informational” note that states:The description for Event ID 4098 from source DBExtractor cannot be found. Either the component that raises this event is not installed on your local computer or the installation is corrupted. You can install or repair the component on the local computer

5
Chris Selph
Seasoned
8 days ago
G
grc5084New
asked in Developer and User Community

Uploading CSV to Staging Area

Hello,I have been trying to load a CSV file into a table while going through the Cognite Data Fusion Fundamentals course. I have tried for over an hour to load the data correctly. One of the column headers adds 2 commas after the text and is throwing off the SQL formula. I am using the stock CSV file provided in the course, loading it straight from my desktop and not making any changes to the file itself.   

4
D
Practitioner
7 days ago
D
Practitioner
DeelakaCSPractitioner
posted in Developer and User Community

Configure SharePoint Extractor

PrerequisitesAdministrative permissions are essential for both the Azure Active Directory instance, where the app registration is hosted, and the SharePoint Server instance to which the extractor will connect. Before proceeding, ensure that the necessary administrative access is in place for a seamless setup and operation of the application.NOTE: It may be the case that the SharePoint Server instance is hosted by the client and inaccessible by Cognite. In this case, you will need to work with a member of the client team to run through the steps where Admin access to SharePoint is required. Azure Active DirectoryFirst, create a new app registration associated with the project and generate a client secret. Navigate to the “API Permissions” tab, add permissions for the Microsoft Graph API with following access:Sites.FullControlAll - Delegated Sites.Read.All - Application User.Read - Delegated (Other permissions) Sites.FillControl.All - ApplicationSharePoint SettingsWarning: This section r

0
D
Practitioner
22 days ago
Luis Atencio Granadillo
Luis Atencio GranadilloNew
asked in Developer and User Community

CDF Fundamentals - Working with CDF - Integrate: Issue when running Timeseries transformation

I’m getting this error after running the Timeseries transformation:  It is relevant to mention that the preview of the SQL query looks fine, prior tu actually running it, looks fine (data can be find here):  Many thanks in advance for your comments. Luis

1
R
Practitioner
21 days ago
D
Active
Dietmar WinklerActive
asked in Developer and User Community

Search does not give any result even for partial match (unless fuzzy is on)

Hi,I’m trying to search for signals where I know some keywords in the name string. I’m not interested in any fuzzy matches but rather just like to see only results which contain a certain phrase. This seems not to be possible unless I activate fuzzy (which then gives to many results). Is there a way to activate “partial match” but without having fuzzy search activated?

0
D
Active
24 days ago
Å
Årne ReimeNew
asked in Developer and User Community

Data model query for Bi-directional relationships

I have a question about querying a data model using the CDF SDK.In the Cognite SDK docs there is an example for retrieving actors in a movie (https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_modeling.html#query-instances) from the following data model: But if we would change this to finding which pumps belongs to a given facility from this data model (picture below), using a bi directional relationship between facility and pump, what changes must be made to the example from the sdk docs for this to work?  

2
D
Practitioner
7 days ago
Andre Alves
Seasoned
Andre AlvesSeasoned
posted in Developer and User Community

Video analytics features

Hi everyone,We are working on a new project related to video analytics and would like to know if there are any features available at Cognite that we can count on as possible components of the solution, such as Cognite Cluster for running object detection/classification, object tracking, partial video events, and overlaying video output.

2
Milad Mobarhan
Practitioner
22 days ago
P
Seasoned
Peter QuinnSeasoned
asked in Developer and User Community

Is there a InfluxDB extractor?

We have customers using InfluxDB as a local on-prem storage mechanism. What’s the best extractor to use to push this data to CDF? I’ve heard OPC-UA is the way to do it, but what I find online are ways to store OPC-UA data into Influx, but not ways to get InfluxDB data into a OPC-UA server so I could use the OPC-UA extractor to get it into CDF.

4
P
Seasoned
15 days ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Access control. Sharing data.

Hi. When setting up CDF we were recommended to use CDF data sets scoped to data sources to control access to data. However, we have use cases where we would like to share a selection of data from a source with external parties. What would be the recommended setup for this? Would we need build an API layer on top of CDF,  to copy data from a source dataset to multiple other datasets for sharing? Or could the security categories feature be used for this?The person in charge of sharing data in our case will often be a data owner / SME without much coding experience. Is there a way our data owners could move/copy a subset of data from a source dataset to a sharing dataset, or somehow label individual time series or assets in a manner making them accessible to specificaccess groups?

4
N
Practitioner
14 days ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings