Community Discussions

We are trying to ingest the data from csv file into Staging table. Below is the config.yaml file.logger:  console:    level: INFO# Information about CDF projectcognite:  # Read these from environment variables  host: https://fusion.cognite.com/  project: sandbox  idp-authentication:    # OIDC client ID    client-id: abc345    # URL to fetch OIDC tokens from    token-url: https://login.microsoftonline.com/gvbiy76/oauth2/v2.0/token    # Alternatively, you can specify an Azure tenant to generate token-url automatically    #tenant: azure-tenant-uuid    # OIDC client secret - either this or certificate is required    secret: abcd    # List of OIDC scopes to request    scopes:      - api://abc345/.default  # Data set to attach uploaded files to. Either use CDF IDs (integers) or  # user-given external ids (strings)  data-set:    id: 28834    #external-id: File_Extractor# (Optional) Extractor performance tuning.extractor:  schedule:    type: interval    expression: 5m# Information about files

Hi,I am setting up MFA on my new device and going through this https://cognite.zendesk.com/hc/en-us/articles/360019771298-How-to-Sign-up-for-Cognite-Hub The images are missed in this, can you please help me to send the details. Thanks.  

I’m trying to use Update extraction pipelines method to update my extraction pipelines created. Here are some issues i face:1. I’m unable to update contacts for an extraction pipeline, it throws the below error:code - contact_info = [ExtractionPipelineContact(name="sangs", email="sm6@slb.com", role = "MAINTAINER", send_notification=True)]to_update = ExtractionPipelineUpdate(external_id="<PIPELINE-EXT-ID-2>")to_update.contacts.set(contact_info)client.extraction_pipelines.update(to_update)error - “CogniteAPIError: Unexpected field - items[0].update.contacts.set[0].send_notification - did you mean sendNotification? | code: 400 | X-Request-ID: 918d1113-6a5e-9d38-b850-61e3dc54c220 The API Failed to process some items. Successful (2xx): [] Unknown (5xx): [] Failed (4xx): [<PIPELINE-EXT-ID-2>, ...]”2. I’m unable to set the specified fields to None using sdk : description, source, schedule,documentation, name and dataset-id. Im able to set only metadata and raw-tables to None. Wond

OEM’s are focusing on performance based contracts but are lacking information about their installed assets . It’s important to create a data foundation to map all assets . How does Cognite provide solutions ,is it by integrating with SAP /Maximo ?

Hello,As per your documentation for the SkipState behaviour:'In case of failures, retries will be performed until exhausted, after which the task is marked as FAILED and the Workflow is marked the same. In the event of a timeout, no retries are undertaken; the task is marked as TIMED_OUT and the Workflow is marked as FAILED.'But this is not what happens:  

CogniteAPIError when listing eventsI have observed an error raised when listing events that I have never seen before. Below is the full traceback 2024-10-28 03:35 : Traceback (most recent call last):2024-10-28 03:35 : File "/app/function/***/***/***.py", line 95, in get_events2024-10-28 03:35 : events = self.client.events.list(2024-10-28 03:35 : ^^^^^^^^^^^^^^^^^^^^^^^^2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api/events.py", line 817, in list2024-10-28 03:35 : return self._list(2024-10-28 03:35 : ^^^^^^^^^^^2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api_client.py", line 532, in _list2024-10-28 03:35 : for resource_list in self._list_generator(2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api_client.py", line 463, in _list_generator2024-10-28 03:35 : res = self._post(2024-10-28 03:35 : ^^^^^^^^^^^2024-10-28 03:35 : File

I'm seeking help and guidance from customers who have tackled or enabled features to improve the LINES when connecting files and assets within Cognite Canvas.We seek to have our connected lines more accurately flow and follow P&IDs as they are added to the canvas.  Making the lines conform and adjust vs. extending across the visuals on the canvas.This means these lines should follow the “path” on the connected P&ID where they begin on the document vs. connecting randomly into the side of the document. 

When using Co-pilot to interrogate a document, it returns an answer and links to the page of the document from where Co-Pilot inferred the answer.  If you click any of those links, the document jumps to that page, but Co-Pilot disappears.  You cannot get back to the co-pilot pop-up to click the next link.  If you ask the question again, you get a different answer.  The original prompt, answer, and links need to remain visible and clickable until the user closes the window or asks another question. 

Are there any way of using the javascript SDK without storing access tokens in local storage (or similar)? We would really like to store access tokens in a location where the browser’s JS runtime don’t have access (such as an http only cookie). If not, are there any plans of supporting that?

We have an OPCUA Server (Server) that sends an array (Array) of length 500 every second. We need an OPCUA Client (Client) to stream this array to cloud.First, we use UaExpert an open-source software as Client. Here we can see a node for Array which has values of Array[0], Array[1], Array[2], Array[3], … Array[499] Next, we use Cognite OpcUaExtractor as Client to stream data to cloud. But we result in only Array[0] being sent in each instant (second). I have tried to adjust different parameters in config file with no success.

In a hypothetical scenario where we need to extract asset hierarchy directly from PDF-based P&ID documents, does Cognite provide a built-in library to support this? Or would we need to rely on external libraries like PyMuPDF or pdfplumber for data extraction—or even tools like Pytesseract in cases involving scanned images?Thank you for any guidance on best practices or integrations for this use case!

We are looking to add Events into our CDF solution via an existing OPC UA Extractor. The OPC UA Extractor is currently pulling data from KEPServer and pushing into time-series end-points.We want to add some of the binary & string references in the PLC (which are now exposed in KEPServer) as Events so that we can utilize the Charts over-lay function.Is there a worked method for updating the OPC UA Extractor file for this purpose? Does it require KEPServer Alarms & Events plugin to be used? We have used this link already: Configuration settings | Cognite Documentation

Hello everyone in the community,I have a question:I have a project created with CDF and the assets are already contextualized with the P&IDs. I received new revisions of plans.My question is, do I have to contextualize everything again and what has already been contextualized is lost? Is there a way to only upload the new plans in the new revisions and have it done automatically?

I am looking at 127 time series linked to one asset and I want to download the list of these time series as shown in the screenshot below, but this doesn’t appear to be straight forward.The download button circled in blue saves a JSON file linked only to the asset “11. QHP”. Is there a way to spare the user the effort of manually selecting and downloading each of the 127 timeseries and later reassemble them into one table like the one shown in the browser?  It is not possible to select and display more than 20 columns in the browser … due to performance issues. This is not critical at this time, but still dissatisfying. I want to download everything wholesale and pick what I need from the list locally. Is there a way around this restriction? Solving issue #1 would remedy also #2, as I’d be able to join the tables locally again. Thanks

Search option is not working in non-pdf document at CDF for Documentum.Steps to reproduce the issue: Login to CDF Click on Data Explorer tab in CDF menu bar. Click on Files tab in right side of the panel. Set Data set as ‘src:006:documentum:b60:ds’ under Common filters in left side of the screen. Enter the file name ‘ELECTRICAL SAFETY RULES.docx’ in search bar. Click to open the file. Expected results: User should be able to see the preview of file and search the any word inside the document.Actual results: Search option is not working in preview of file and displaying message ‘this document is not searchable.’

Hello Cognite Community,I am working on a workflow that involves receiving a daily email with a consistent title in Outlook. Each email contains an attachment that I need to extract and process. I'm looking for a way to automate this extraction process using Jupyter Notebook.Has anyone implemented a similar solution or could guide me on how to approach this? Specifically, I’d like to:Identify emails by their subject line Download the attachment(s) automatically Work with these files within a Jupyter Notebook environment for further analysisAny suggestions, code samples, or libraries that could help with this integration would be greatly appreciated!Thank you in advance for your insights

 Hello,  We are unable to select version of workflow from the UI. for instance here we are at version 0.0.39 and in the UI the workflow is at version 0.0.1.I think this might be an UI issue. Thanks

Hi.I’ve set up a data model with 26 containers. How come only the first 10 of them (in alphabetical order) show up in the Fusion UI? I successfully return all 26 containers using the python SDK:client.data_modeling.containers.list(space="sp_kra_enterprise_model", limit=None) 

Hi.I’ve got an enterprise data model set up, and built a test solution model with a subset of the enterprise model, and also expanding one of the views. Somehow my solution model does not show in the UI - only a spinning wheel is shown. Does anyone know where I can start to troubleshoot this?  I’m able to populate the model with transformations, and I can retrieve the resulting nodes using the Python SDK, so the model seems to be working. Can this be only a UI issue?

Intermittent Internal server is seen while reading RAW table. It is happening in different functions that may not be part of some workflows. It is blocking workflow to run as we use these staging tables to get information for other functions. Is there is any check that needs to implemented ?  

I’m using cognite/reveal and cognite/sdk for a project developed in react (18.x).While connecting cognite/reveal with react application I’m encountering this error:e.BufferGeometry is not a constructorTypeError: e.BufferGeometry is not a constructor I would like to know what is causing this error. code attached below:-   A help to figure out the issue would be helpful.Thank you, Regards,Hariharan B P 

Hi Community,I would like to know if anyone have information on how the Cognite Streamlit Reveal python package full feature & capability documentation? Second, can the "cognite-streamlit-reveal” have the zoom in / zoom out event trigger? This is because we want to develop a use case where user able to zoom in into the oil rig plaform 3D and once the zoom stop, it able to send and event to show what are the bounding box of that area so that we can load data related to that specific area during zoom in and zoom out interaction. Thanks

Hello!I'm trying to develop a PowerBI dashboard but encontered some situations where it's impossible to not expand new columns or lists from the nodes (foreign key from dimension table is inside the node) and I understand this drops the performance considerably (sometimes even turns impossible to load the table) of the model in the dashboard.Is there a way to query the data straight from the connector? I know there's the possibility of making simple filter queries but I wasn't able to use other type of OData queries that exists. We need a solution that simplifies this since currently it's impossible to load more complex data models into PowerBI without expanding the nodes.Please understand that I want to keep this situation as low code as possible, so an API or SDK solution is not an option.Thanks!

Hi,I am working on one of the project where I am using MQTT extractor to inject data into CDF. Kindly advise best optimized stepwise solution to integrate and transform data into CDF.Note that it is Sparkplug B-formatted MQTT data.Kindly advise.Regards,Amol S Pawar

Hi Team,I'm excited to be registered for the Data Engineer Basics course, specifically the “Learn to Use the Cognite Python SDK” section!While working through the “List, Search, Retrieve” portion, I came across an issue. The documentation states that the general pattern for search operations is `client.<cdf_resource_type>.search()`, where `<cdf_resource_type>` could be `data_sets`, `asset`, `time_series`, `events`, `files`, `labels`, and so on.Following this, I tried the code:```pythonc.data_sets.search()```However, it resulted in the following error:```AttributeError: 'DataSetsAPI' object has no attribute 'search'```I double-checked the Python SDK documentation but couldn't locate a `search()` function for `data_sets`. Could you please let me know if I missed something? And if the `search` function for `data_sets` is indeed unavailable, perhaps it could be noted in the documentation to prevent future confusion?Thank you for your help and for the informative course! Best re