Skip to main content

Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 802 Topics
  • 2,535 Replies
802 Topics
Pablo Palacios
Seasoned
Pablo PalaciosSeasoned
asked in Developer and User Community
Excel Extractor

Hello:I am using DB Extractor  v 3.4.3 to read columns from an Excel file but it gives me the following error: 2024-08-20 18:53:06.550 UTC [ERROR ] QueryExecutor_0 - Unexpected error in query1: Could not read file C:\Cognite\SAT-SX4 - 2023-03-21.xls: required package 'xlsx2csv' not found.Please install using the command `pip install xlsx2csv`.The following is my config file:  databases: - type: spreadsheet name: "DSN_FT" path: "C:\\Cognite\\SAT-SX4 - 2023-03-21.xls" queries: - name: query1 database: "DSN_FT" sheet: "P_VSD" query: #"SELECT STS PreCOM FROM SAT-SX4 - 2023-03-21.xls" "SELECT * FROM P_VSD" destination: type: raw database: FTV table: AE_MOLYNOR primary-key: "{EventID}" What am I doing wrong? Can you help me? 

8
Pablo Palacios
Seasoned
3 days ago
D
Seasoned
Diana Chimnaz JohanSeasoned
asked in Developer and User Community
Python with puodide

I am trying to install some python packages that do not appear to have a wheel which turns into a problem because , as far as I know, pyodide is not able to install packages without a wheel. Here is an example of an error I am receiving  - “Can't find a pure Python 3 wheel for 'psutil==5.9.5'.”-How can I address this issue in Jupyter Notebook and streamlit? Is there a workaround? Is there a way to use a different kernel instead of pyodide?I am not facing this issue with CDF functions. How does CDF functions environment differ from Jupyter Notebook and streamlit?

8
Murad Sæter
Practitioner
1 month ago
X
Seasoned
Xiaofeng WangSeasoned
asked in Developer and User Community
Filtering based on externalID

Hi,To apply a startWith filter on a property, we can do:prop_view = client.data_modeling.views.retrieve(('myspace', 'myview'))filters.Prefix(prop_view[0].as_id().as_property_ref("myPropertyName"),"xxx")This is working fine. However, as the externalId is not a property so the code below doesn’t work:filters.Prefix(prop_view[0].as_id().as_property_ref("externalId"),"xxx")and the error message is: “Invalid prefix filter with property reference [myspace, myview/94b12855a09cf4, externalId]. View myspace:myview/94b12855a09cf4 does not have property externalId.” Could you help find out how to apply a startWith filter on externalId in python sdk? Regards,Xiaofeng

8
X
Seasoned
1 year ago
R
Active
RincyCActive
asked in Developer and User Community
Monthly Aggregation: End date discrepancy

Hi,I am using Time zone and Calander granularity function (Release timezone and calendar features in DatapointsAPI (beta) by haakonvt · Pull Request #1779 · cognitedata/cognite-sdk-python · GitHub)I am facing an issue wherein I am passing following datadps_lst = client.time_series.data.retrieve_dataframe_in_tz(   external_id=list,   start=datetime(2023, 6, 24, tzinfo=ZoneInfo("America/New_York")),   end=datetime(2024, 6, 27, tzinfo=ZoneInfo("America/New_York")),   aggregates="average",   granularity="1month") For the End date time is given as 27th June 2024; while I am expecting to get a calculation from 1st June- 27th June; I am receiving an output from 1st June- 30th June. the functionality is not considering “end” date while calculating.  

8
Dilini Fernando
Seasoned Practitioner
10 days ago
T
Active
tomaskurtenperezActive
asked in Developer and User Community
Error in Learn to Use the Cognite Python SDK

Getting an error on 2_List_Search_Retrieve.ipynb:c = cauth.create_cognite_client(method="client-secret")AttributeError Traceback (most recent call last) c:\Users\tomas.kurten.perez\Downloads\COGNITE\using-cognite-python-sdk\notebooks\2_List_Search_Retrieve.ipynb Cell 7 in <cell line: 1>() ----> 1 c = cauth.create_cognite_client(method="client-secret") AttributeError: module 'auth' has no attribute 'create_cognite_client'

8
Dilini Fernando
Seasoned Practitioner
1 year ago
N
Committed
nabanitakarCommitted
asked in Developer and User Community
Is Cognite AIR getting decommissioned.

Hi, We like to use Cognite AIR in one of our project .We got to know that it is getting decommissioned by end of 2023.Kindly confirm on that whether we should explore AIR now or we should not as it will not be available after this year. Thanks,  

8
Arun Arunachalam
Seasoned Practitioner
1 year ago
N
Committed
nabanitakarCommitted
asked in Developer and User Community
Can I use Asset Hierarchy in Grafana

My Question is : Is it possible to use  Asset Hierarchy in Grafana?I found many things related to timeseries  but not related  Asset Hierarchy to Grafana. Thanks. 

8
K
Practitioner
1 year ago
E
Active
Espen JacobsenActive
asked in Developer and User Community
Retrieving many raw datapoints from many timeseries

Hi We have a web application that uses the cognite sdk to present timeseries and datapoints.We have two use cases:1. We have a case with 500 time series, and we need to retrieve the latest 1000 data points from the combined 500 time series.2. We have a case with 500 time series, and we need to retrieve all datapoints between two dates. For both cases we also need to know which timeseries each datapoint belongs to and we need raw values and can not use aggregates.What is the most effective approach to achieve this?

8
E
Active
9 months ago
S
Seasoned
Sangavi MSeasoned
asked in Developer and User Community
SDK: extraction pipeline update method is not working as expected

I’m trying to use Update extraction pipelines method to update my extraction pipelines created. Here are some issues i face:1. I’m unable to update contacts for an extraction pipeline, it throws the below error:code - contact_info = [ExtractionPipelineContact(name="sangs", email="sm6@slb.com", role = "MAINTAINER", send_notification=True)]to_update = ExtractionPipelineUpdate(external_id="<PIPELINE-EXT-ID-2>")to_update.contacts.set(contact_info)client.extraction_pipelines.update(to_update)error - “CogniteAPIError: Unexpected field - items[0].update.contacts.set[0].send_notification - did you mean sendNotification? | code: 400 | X-Request-ID: 918d1113-6a5e-9d38-b850-61e3dc54c220 The API Failed to process some items. Successful (2xx): [] Unknown (5xx): [] Failed (4xx): [<PIPELINE-EXT-ID-2>, ...]”2. I’m unable to set the specified fields to None using sdk : description, source, schedule,documentation, name and dataset-id. Im able to set only metadata and raw-tables to None. Wond

8
Dilini Fernando
Seasoned Practitioner
13 days ago
C
Active
Christopher WhealyActive
asked in Developer and User Community
Setting HTTP headers for CORS policy

Hi all - I’m new to CDF.I’d like to call CDF from JavaScript running in a browser using a bearer token as authentication.This request works fine when made from a tool such as Postman, but when the same call is made from JavaScript running in a browser using the same URL and bearer token, the browser’s CORS policy blocks the request because CDF has not responded to the preflight OPTIONS request with the HTTP header Access-Control-Allow-Credentials: trueApart from this, CDF is correctly sending out all the other HTTP headers needed to satisfy the browser’s CORS policy such asAccess-Control-Allow-HeadersAccess-Control-Allow-MethodsAccess-Control-Allow-OriginAccess-Control-Expose-HeadersAccess-Control-Max-AgeWhere do I configure CDF to respond with this additional HTTP header?Thanks  

8
F
Practitioner
1 year ago
E
Active
Erling JohannessenActive
asked in Developer and User Community
MQTT Extractor

I am trying to connect to an MQTT broker with Cognite’s MQTT Extractor.I know that the broker is fully functional, verified by several tools.However, when completing the “Add MQTT Topic”.Error code indicates that the API does not accept “Datapoints” as “Target type”, even though “Target type” is a mandatory field in the interface window. And: “Datapoints” is the only available selection.Any quick feedback to progress my testing is appreaciated! 

8
C
Seasoned Practitioner
11 months ago
S
Seasoned
Sangavi MSeasoned
asked in Developer and User Community
Retrieve nodes/edges by their external ids API

Hi!I was trying out this API: https://pr-ark-codegen-1646.specs.preview.cogniteapp.com/v1.json.html#tag/Instances-(New)/operation/byExternalIdsInstances.When i try to Retrieve a node by external id by giving source details as well, it works fine for a single View-ID pair. But when i try to do for more than one, I’m getting empty response.Example: Say Id1 belongs to View1, and Id2 belongs to View2.Querying with (Sources : View1, items : id1) as well as (Sources : View2, items : id2) gives correct response as expected. But when I try (Sources : [View1,View2], items : [id1,id2]), i get empty response. I was hoping it would provide information on both Id1 and Id2

8
S
Seasoned
1 year ago
N
Seasoned
Neerajkumar BhatewaraSchlumberger
asked in Developer and User Community
Cognite Python SDK - Error generating access token: invalid_request, 400, too many calls

Hello,We have off late moved from Rest calls to SDK and post that we have started seeing the below errorError generating access token: invalid_request, 400, too many calls What is recommended for this type of error ? Can’t we add a exponential delay at sdk side ?Also it would be important for us to know that this error is given after how many calls ? 

8
N
Seasoned
11 months ago
S
Committed
Snehal JagtapCommitted
asked in Developer and User Community
Issue in calling FDM Post APIs

I am trying new FDM APIs. In POST endpoints I am facing issue “Missing body for POST request”Am I missing some parameters? I am using POST body as per documentation 

7
S
Committed
1 year ago
B
Active
Basudeba MandalActive
asked in Developer and User Community
Getting AttributeError while using "bootstrap-cli prepare" command

Hi Team, I am trying to use bootstrap-cli to create raw DB, CDF groups and datasets. As per the documentation, I am executing “bootstrap-cli prepare” command before applying “bootstrap-cli deploy”. However I am encountering “AttributeError” .  Could you please help me what can be done to fix this? Following are the few details of the issue that is encountered. Command that I used to run the bootstrap-cli prepare.poetry run bootstrap-cli prepare --idp-source-id f2e5b1ef-e601-46ec-87ec-25f62810ad1fError Snippet:Prepare CDF Project ...Traceback (most recent call last):  File "<string>", line 1, in <module>  File "C:\Users\BMandal2\bootstrap\inso-bootstrap-cli\incubator\bootstrap_cli\__main__.py", line 2365, in main    bootstrap_cli()  File "C:\Users\BMandal2\AppData\Local\pypoetry\Cache\virtualenvs\inso-bootstrap-cli-Jo_B4J-G-py3.10\lib\site-packages\click\core.py", line 1128, in __call__    return self.main(*args, **kwargs)  File "C:\Users\BMandal2\AppData\Local\pypoetry\Cach

7
B
Active
1 year ago
T
Active
Trond SaureActive
asked in Developer and User Community
Using a FDM Data model in transformations

I am currently working on a concept for representing tag data in a simple graph (subject - predicate - object - style)An instance of the triple could be something like this D-20VA00001 - hasDryWeight - 5000In parallell I have instanciated another graph holding ontology data and mapping (like CFIHOS, mapping between CFIHOS class and function code and sap referance data etc.) Lets call it the meta-graph.What I want to do is to take a “traditional” tag as input, map the function code on the tag to corresponding CFIHOS-class, and get required attributes in return from the meta-graph. Further I then want to dynamically instanciate every attribute as relation in the triple’ish graph. In order to do this I need to be able to query a data model (FDM) in a transformation- is that far away?Further, now I am faking a labeled property graph in FDM - is LPG functionality far away? 

7
C
Seasoned Practitioner
1 year ago
A
Seasoned
Anders WillersrudSeasoned
asked in Developer and User Community
[Bug] Transformation access require group "tranformations" and legacy login

We are currently migrating to OIDC where we need to give access through access groups linked to Azure AD.On our Statnett cluster it seems that a user needs to explicitly be member of a group “transformations” in order to to delete (or edit) a transformation.The admin group has the capabilities  (on “test”) {'transformationsAcl': {'actions': ['READ', 'WRITE'], 'scope': {'all': {}}}}]But we need to login to the legacy login without OIDC and have a service account linked explicitly to the group “transformations” in order to delete a transformation. The group “transformations” has no capabilities set.I have tried both Fusion and the API/python-SDK (read is possible):CogniteAPIError: Transformation not found. This may also be due to insufficient access rights. | code: 403 | X-Request-ID: b7c0beb6-d3e0-9ec4-ba50-895533ac1996

7
C
Seasoned Practitioner
2 years ago
P
Practitioner
Prashant ChauhanPractitioner
asked in Developer and User Community
DB Extractor: Multiple query execution via single .ymal file

How can I execute two or more different queries extracting the data from the source and inserting the data in the same CDF RAW table?Currently only the last query available in the config.yaml file gets executed. 

7
P
Practitioner
1 year ago
Anders Brakestad
Seasoned
Anders BrakestadSeasoned
asked in Developer and User Community
How to ensure identical DateTimeIndex in TS data from CDF and Pi (via Seeq API)

I am trying to make a comparison between time series data from CDF and from Pi (accessed with the Seeq Python API). Some questions arise:​​​​​How do I ensure that the DateTimeIndex-s that are returned are identical? Why does CDF return DateTimeIndex with dates before my start value?Examples:Pulling a raw time series from Pi via Seeq looks like this:start = datetime(2021, 1, 1)end = datetime(2021, 1, 2)spy.pull(items, start=start, end=end, grid=None, quiet=True)And the CDF analog looks like this:start = datetime(2021, 1, 1)end = datetime(2021, 1, 2)cognite.datapoints.retrieve_dataframe( external_id=external_id, start=start, end=end, granularity=None)The resulting DateTimeIndex-es are not identical:From Pi via Seeq:DatetimeIndex(['2021-01-01 00:00:00+01:00', '2021-01-01 00:00:05+01:00', '2021-01-01 00:00:10+01:00', '2021-01-01 00:00:15+01:00', '2021-01-01 00:00:20+01:00', '2021-01-01 00:00:25+01:00', '2021-01-01 00:00:30+01:00', '2021

7
Anders Brakestad
Seasoned
1 year ago
C
Seasoned Practitioner
Crystal Connor RichardsSeasoned Practitioner
asked in Developer and User Community
InField Demo using 55 inch Android Tablet?

Hello @Kristoffer Knudsen @ibrahim.alsyed  would like to know if Cognite InField would work ok for demo purposes on a giant smartphone (android  55’’)Celanese is planning to demo this to 100 people using something like this https://www.giantitab.com/ cc: @MortenNesvik @Kriti Dhaubhadel @Philippe Bettler @piya dey @Ajo 

7
D
Practitioner
1 year ago
N
Seasoned
N G NidhiSeasoned
asked in Developer and User Community
Azure Pipeline

Hi TeamI am working on cognite  Functions and  we have 3 cognite instances now,Tiger-trainingDemo-devdemo-prodI have created the pipeline such a way that it is built and deployed with the single run and it is pointing to either of the instance based on the credentials provided in azure.pipeline.yaml file.functions-deploy-azure-pipelines/azure-pipelines.yaml at main · cognitedata/functions-deploy-azure-pipelines · GitHub I am using the same pipeline file which is mentioned in the above linkSo now my requirement is to build a separate build pipeline  that will build our cognite functions code, it builds and zips theCognite functions and create separate release pipeline for  and Deploy the zipped functions code to 3 different instances independently.Please help me on this as it is a show stopper for us, please set up a call anytime before 9 pm today and after 10.30 am tomorrow. Regards,Nidhi N G

7
Anita Hæhre
Seasoned Practitioner
1 year ago
N
Committed
Niranjan Madhukar KarvekarCommitted
asked in Developer and User Community
DB extractor - storing incremental state for Timeseries query

Hi, I am observing below error(in bold) in extractor log for timeseries query: 2023-01-24 03:31:03.345 UTC [INFO    ] QueryExecutor_0 - Starting extraction of avocet-timeseries2023-01-24 03:31:03.345 UTC [DEBUG   ] QueryExecutor_0 - Query: 'SELECT ITEM_ID + PROPERTY_TYPE+'Avocet' as "externalId", START_DATETIME as timestamp, PROPERTY_VALUE as value FROM ITEM_PROPERTY1 WHERE START_DATETIME is not null and PROPERTY_VALUE is not null and LAST_UPDT_DATE is not null ORDER BY LAST_UPDT_DATE ASC'2023-01-24 03:31:03.612 UTC [INFO    ] QueryExecutor_0 - No more rows for avocet-timeseries. 2 rows extracted in 0.267 seconds2023-01-24 03:31:03.873 UTC [DEBUG   ] ThreadPoolExecutor-9_0 - https://westeurope-1.cognitedata.com:443 "POST /api/v1/projects/slb-pdf/timeseries/data HTTP/1.1" 200 222023-01-24 03:31:03.875 UTC [DEBUG   ] ThreadPoolExecutor-9_0 - HTTP/1.1 POST https://westeurope-1.cognitedata.com/api/v1/projects/slb-pdf/timeseries/data 2002023-01-24 03:31:03.877 UTC [INFO    ] QueryExecutor_0

7
N
Committed
1 year ago
Johan
Committed
JohanCommitted
asked in Developer and User Community
Charts: Two feature suggestions

can you enable scrolling just for the section of the page where one creates the logic? (see attached picture) it would be nice if I could specify the degree of an exp. for instance y = ax^b+c would be a second order exp, For my specific usecase a = timeseries, b = constant and c = constant.

7
Gustavo Zarruk
Practitioner
2 years ago
P
Committed
Paramale AratiCommitted
asked in Developer and User Community
Schedule refresh unavailable for Cognite thru Power BI

HI, May i know how to schedule a refresh in Power BI for Cognite as i am facing below error?When i try to schedule, i see it is disabled for me.I tried to install the gateway locally as well but it says installation failed.While establishing the connection with CDF on PBI desktop i get pop-up as third party connector. Does that mean PBI service doesn't support scheduling for Cognite?Please help.TIA.Regards,Arati

7
Dilini Fernando
Seasoned Practitioner
1 year ago
H
Seasoned
henning.kvinneslandSeasoned
asked in Developer and User Community
Global error-handling

What is best practice for global error-handling in the JS-SDK?

7
H
Seasoned
2 years ago

Badge winners

  • Cognite Domain Expert Basics
    Chrisrodburhas earned the badge Cognite Domain Expert Basics
  • Cognite Sales Enablement Basics
    Gabriel Parreiras Duartehas earned the badge Cognite Sales Enablement Basics
  • Cognite Data Scientist Basics
    anthonydanghas earned the badge Cognite Data Scientist Basics
  • Cognite Data Engineer Basics - Integrate
    Jayhas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Fusion Fundamentals
    Bhushan Kumarhas earned the badge Cognite Data Fusion Fundamentals
Show all badges
Terms & ConditionsCookie Settings