Community Discussions

Hello Community,The Records and Streams APIs are now available for early adoption, with an expected announcement of Beta software maturity level in January 2025. Intended use cases for Records are the storage of high volumes of structured data such as Logs (i.e. Alarms and Events, Manufacturing Logs and Well Logs), and Historic Data.  The API is designed to handle hundreds of billions records per year, from various source systems.  Use cases that currently store historic data as Nodes in the industrial knowledge graph are excellent candidates for the use of the new API.Early adoption means Cognite provides you access to pre-production APIs (and later SDKs) in return for engagement and feedback during the product development process.  By default, the APIs are not enabled in every customer project.Early adoption intended to provide those customers who are interested in utilising the API functionality in their future plans, the ability to gain an understanding of the product concepts, pro

@Tanmay Deshpande and @Tom Jonsthovel , posting your question here to make it easier to engage the developer team for support. We have successfully created the ILA group and can call the API, however we currently get stuck on ingesting logs (400 - bad request). Please see our steps below.  It would be great if you could advise on how to properly ingest logs and share a Jupyter notebook with some examples. Also, would be great to understand the link between the ingested log and the container. Eg, do we need to add a 'log' property to the container definition?Created a data model. Ingest a log into the container with externalId "Pump" and link to "Pump" instance with externalId "66470bf0-5c07-4a39-8878-0adf4dc7f448"Get 400 on return. 

Hi Everyone,I’m reaching out to the community to gather valuable feedback and insights on Cognite Data Fusion (CDF), specifically its Canvas + Charts features as applied to Root Cause Analysis (RCA).How are these tools impacting the RCA process? In your experience, how have the quality, dependability, and response time of RCA processes improved since implementing CDF? What kind of improvements have you observed in identifying root causes, especially in terms of speed and accuracy? With the inclusion of Generative AI (GenAI) within CDF, how has AI-driven data exploration changed your RCA workflows?I’d greatly appreciate hearing about how the combination of Canvas, Charts, and GenAI is transforming the way you approach RCA, and any real-world examples or challenges you’ve faced.Looking forward to your insights!RegardsMuhammad Waqas 

A chart in Canvas should update if it is changed in Charts. For example, I added a Chart to my Canvas. Then I added another timeseries to my Chart. But in Canvas, the chart didn’t update with the new timeseries. 

I am trying to update column value in view using upsert method, but it's not working and giving 400 error code.  adding screenshot of upsert api, as its not matching with the input structure provided in document.

Hi there,Before I begin, some terminology to make sure we are on the same page.CDF tenant = CDF project (these have been used interchangeably over time, not sure which is applicable at the moment, I will be referring to it as tenant)CDF cluster = The cloud cluster where the CDF tenants/projects/instances are hostedNow, let’s begin.At Aker BP we have been migrating over to a dedicated CDF cluster on Azure and we have been experiencing some pain points with regards to the compute resources being shared for all tenants on the cluster. Previously our CDF tenants were hosted on GCP on a cluster shared with other companies, this cluster is scaled to handle multiple customers and so the base scaling of the compute resources is much higher than it would be on a dedicated cluster, and as such these problems are less likely to be encountered, not impossible just not as likely. The problem we have seen is that if we from our dev tenant overload the API then the API becomes unavailable for all our

OEM’s are focusing on performance based contracts but are lacking information about their installed assets . It’s important to create a data foundation to map all assets . How does Cognite provide solutions ,is it by integrating with SAP /Maximo ?

Hello,As per your documentation for the SkipState behaviour:'In case of failures, retries will be performed until exhausted, after which the task is marked as FAILED and the Workflow is marked the same. In the event of a timeout, no retries are undertaken; the task is marked as TIMED_OUT and the Workflow is marked as FAILED.'But this is not what happens:  

CogniteAPIError when listing eventsI have observed an error raised when listing events that I have never seen before. Below is the full traceback 2024-10-28 03:35 : Traceback (most recent call last):2024-10-28 03:35 : File "/app/function/***/***/***.py", line 95, in get_events2024-10-28 03:35 : events = self.client.events.list(2024-10-28 03:35 : ^^^^^^^^^^^^^^^^^^^^^^^^2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api/events.py", line 817, in list2024-10-28 03:35 : return self._list(2024-10-28 03:35 : ^^^^^^^^^^^2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api_client.py", line 532, in _list2024-10-28 03:35 : for resource_list in self._list_generator(2024-10-28 03:35 : File "/user_env/lib/python3.11/site-packages/cognite/client/_api_client.py", line 463, in _list_generator2024-10-28 03:35 : res = self._post(2024-10-28 03:35 : ^^^^^^^^^^^2024-10-28 03:35 : File

I'm seeking help and guidance from customers who have tackled or enabled features to improve the LINES when connecting files and assets within Cognite Canvas.We seek to have our connected lines more accurately flow and follow P&IDs as they are added to the canvas.  Making the lines conform and adjust vs. extending across the visuals on the canvas.This means these lines should follow the “path” on the connected P&ID where they begin on the document vs. connecting randomly into the side of the document. 

When using Co-pilot to interrogate a document, it returns an answer and links to the page of the document from where Co-Pilot inferred the answer.  If you click any of those links, the document jumps to that page, but Co-Pilot disappears.  You cannot get back to the co-pilot pop-up to click the next link.  If you ask the question again, you get a different answer.  The original prompt, answer, and links need to remain visible and clickable until the user closes the window or asks another question. 

Are there any way of using the javascript SDK without storing access tokens in local storage (or similar)? We would really like to store access tokens in a location where the browser’s JS runtime don’t have access (such as an http only cookie). If not, are there any plans of supporting that?

We have an OPCUA Server (Server) that sends an array (Array) of length 500 every second. We need an OPCUA Client (Client) to stream this array to cloud.First, we use UaExpert an open-source software as Client. Here we can see a node for Array which has values of Array[0], Array[1], Array[2], Array[3], … Array[499] Next, we use Cognite OpcUaExtractor as Client to stream data to cloud. But we result in only Array[0] being sent in each instant (second). I have tried to adjust different parameters in config file with no success.

Hello Cognite Community,I am working on a workflow that involves receiving a daily email with a consistent title in Outlook. Each email contains an attachment that I need to extract and process. I'm looking for a way to automate this extraction process using Jupyter Notebook.Has anyone implemented a similar solution or could guide me on how to approach this? Specifically, I’d like to:Identify emails by their subject line Download the attachment(s) automatically Work with these files within a Jupyter Notebook environment for further analysisAny suggestions, code samples, or libraries that could help with this integration would be greatly appreciated!Thank you in advance for your insights

Happy Friday!We wanted to end the week with the news that both File Download and search & filtering in Tree view is now available in Search, see below product update post: Worth noting; the search & filtering ability in Tree view is available for projects with asset-centric data modeling. For projects where the data is modeled as an industrial knowledge graph, the same functionality will be made available as part of the official Q4 release December 3. Best, Sofie Berge, Product Manager

 Hello,  We are unable to select version of workflow from the UI. for instance here we are at version 0.0.39 and in the UI the workflow is at version 0.0.1.I think this might be an UI issue. Thanks

Happy Wednesday! We are happy to see the usage numbers in Search growing - and appreciate all feedback and feature requests we receive from you. Product updateWe wanted to share in this group a product enhancement released yesterday; document categories are now available in Search. Proper documentation will be available as part of the official Q4 release, but we wanted to release this much-requested functionality as soon as possible - especially as for many of our users, it has been a key missing feature to transition over to Search from Data Explorer fully 🤗See the post here: Note that we shared details on how the categorization works “under the hood” in the comments of above post.  Preparing for the Q4 releaseIn the Q4 release, we are removing Data Explorer from the Industrial tools workspace. If you have been using Data Explorer, you will have seen a banner with a notice about starting to move over to Search since the end of last week. Data Explorer will still be available in the d

Hello!I'm trying to develop a PowerBI dashboard but encontered some situations where it's impossible to not expand new columns or lists from the nodes (foreign key from dimension table is inside the node) and I understand this drops the performance considerably (sometimes even turns impossible to load the table) of the model in the dashboard.Is there a way to query the data straight from the connector? I know there's the possibility of making simple filter queries but I wasn't able to use other type of OData queries that exists. We need a solution that simplifies this since currently it's impossible to load more complex data models into PowerBI without expanding the nodes.Please understand that I want to keep this situation as low code as possible, so an API or SDK solution is not an option.Thanks!

Hey Everyone!Curious about how to boost your rank and unlock some amazing new abilities in the community? 🚀 If you haven’t checked it out yet, we’ve just shared an exciting update about the perks awaiting you when you reach Level 4 (Practitioner). From marking correct answers to unlimited post editing, these benefits are designed to empower you as a community leader.👉 Check out the full details here!👈Ready to take your engagement to the next level? Head over to the original post for all the details and start leveling up today!

Hello !  I am new to this community but would like to ask the following:   Has anybody any experience extracting a list of DCS Process Alerts to Operators or Operator Overrides on an Hourly or Daily basis into CDF ?   This data resides in the OT and is sometimes extracted and made available in reports in the IT domain, e.g., by Yokogawa.   As I see it, this is an important indicator for stable and well managed production operations, and also a good predictor of upcoming threats to production.

dear all I was attempting to perform data aggregation based on the date. I am retrieving online data into CDF, which is updated every 2-3 minutes. I am trying to aggregate the data so that the date is updated every 24 hours instead of every 2-4 minutes.I used this code to obtain the list of columns in my data frame.# Check the structure of the DataFrame, including column names and the first few rowsprint(dp.columns)  # This will show all column namesdp.head()          # This will show the first few rows of the DataFrame however, I got only this after running the code I tried to use another code again the first column is not date column.  

Dear developer community,The Cognite product team building the GraphQL API for our Data Modelling API is planning to upgrade third party libraries used in the implementation of the service. This is part of our normal product lifecyle and maintenance, and would not normally be something we make a dedicated announcement of. The upgrade brings improved validation, performance, and other fixes.However we have seen that this upgrade is liable to cause issues for some clients that make GraphQL requests that are not compliant with the GraphQL specification. Specifically, primitive types in field values will no longer be coerced into the correct type by the GraphQL server. So, for example, a client sending the string ”true” where the boolean value true would be correct will, after the upgrade, receive an error rather than the server quietly accepting and converting the value.This behavior change should not be an issue for anyone using one of the compliant third party GraphQL client libraries o

Hi Everyone,Have you heard about the Cognite Most Valuable Professional (MVP) Program? If not, it’s time to check it out and see how you can take your community engagement to the next level!Being an MVP is more than just a title. It’s a recognition of your skills, contributions, and leadership within the Cognite ecosystem. Whether you're answering questions, posting topics, sharing ideas, or leveling up your expertise through our comprehensive learning path offering – every step gets you closer to becoming a recognized leader.If you're already contributing, keep up the great work – you're closer to MVP than you think! And if you're just getting started, now is the perfect time to dive in. Check out the full post about our MVP program here to learn more about the program and see how you can start your MVP journey today!Let’s motivate each other, engage more, and climb the leaderboard together. Who will be our next MVP? 🌟

Hello All! As this is my first time writing, I will do a quick introduction. My name is Patrick Mishima, and I am one of the Cognite Product Specialists. My main specialization is data integration and governance. I've worked with data since 2011 with different roles, projects, and job titles all related to data management. I also have experience with various ETL and BI tools, mainly from Microsoft and SAP and a few others.I lead the Product Specialists team, and we'll soon have more articles to share our knowledge and experience with you.Today and in my following articles, I will focus on the different options that Microsoft Azure and Cognite offer on data integration between our platforms and tools. But first, let's talk about a few essential and fundamental points when working with cloud providers. Using a cloud provider, most of the time, we think about saving on infrastructure costs. That is indeed true, but it's not the only truth. When you decide to move to a cloud provider, you

Hello,I am trying to understand the difference between Sequences and Events to see what is pertinent for me in a specific use case. For me, both of them allow saving a native CDF object along with a timestamp, enriched with other data. I feel like we can also achieve the same goal by making a data model with timestamps in one column and all the properties we are interested in, in other columns;  though this approach would be harder because it would necessitate using pygen for input output. In my company, we work on Industrial processing lines. At any given moment, a line is operating under a set of conditions, defined by a fixed set of set points, like ‘conveyor speed’ and various temperatures. Let us call the set points a, b, c etc. For set points a, b and c, we have measured values i, j and k.To assess whether the machine is operating normally, we want to compare the aggregated measurements (i-j-k) taken during a period when the set points are a-b-c with a previous instance when the