Community Discussions

We are currently exploring potential use cases with our team, and one of them involves implementing data quality techniques. I was wondering if anyone could share their experience in order to identify the best approach within the Cognite Platform for conducting data quality checks to ensure that all fields in critical tables are populated correctly.In the past, we have implemented a similar solution with a different vendor, utilizing a system that can prevent the flow of erroneous data through our data pipelines by employing validation and integrity checks based on declarative quality expectations.Thank you in advance.

We are pleased to announce an update to the Search, Filtering and Aggregations documentation, detailing enhanced search, filtering and aggregation capabilities for our Assets, Documents, Events, Sequences and Time Series APIs.These additional features are already implemented in the April 2023 update to Data Explorer and are available to use natively within the service APIs. The documentation provides guidance on how to implement advanced filtering, sorting, search and aggregation functionality (which is available on both the standard fields and metadata), so that application users can use much more powerful and expressive search queries to find exactly the data they are looking for.Use is recommended for existing, mature projects, and apply to use cases for the Assets, Documents, Events, Sequences and Time Series APIs.  For new projects and use cases, customers are recommended to work with the newer Data Modelling APIs.The updated documentation may be found here Tell us what you think

Update! See this post for an updated example notebook based on the Cognite Python SDK.We want to make it easy for you to interact with CDF Workflows through Python. Therefore we’ve created a Jupyter Notebook that demonstrates the service using Python and a simple example. Native support in the Cognite Python SDK will be released shortly. Try it out, and feel free to leave feedback or questions in the comments! Note: Download the file below and remove the .txt postfix to open the file as a Jupyter Notebook.

Hey there! We are thrilled to announce the Early Adopter Beta release of CDF Workflows.CDF Workflows is a managed process orchestration service within CDF. Using CDF Workflows, you can effectively coordinate the order and timely execution of interdependent processes such as Transformations, Functions, requests to CDF, and dynamic tasks effectively. Key Highlights Declarative Workflow Definition We have designed Workflow Orchestration with a declarative approach. Users need to specify the tasks to be orchestrated, input parameters, and the desired execution order. This intuitive approach we believe reduces complexity and lowers the bar for adaption. Orchestrating four different processes The Workflow Orchestration service supports the orchestration of four crucial types of processes: Transformations, Functions, CDF, and Dynamic Tasks. This versatility ensures that our workflows can leverage various functionalities, optimizing productivity. Versioning Capabilities Managing changes an

Found a bug? Have a question about how something works? We want to hear about it!As an early adopter if you wish to report a bug simply post a reply below in this thread or create a question / thread in this group and someone from the team will get back to you regarding the issue.  

In this post, I want to mention a tool that can help us troubleshoot issues such as authentication or unexpected errors: FiddlerFiddler is a Windows-only tool that logs HTTP(s) traffic. This will help you to understand what you are sending on the payload in the request and what response you are getting. This is a community-trusted free tool.Some applications don't show descriptive error logs in the UI, which makes it challenging to narrow down the issue; however, you can get a better understanding of what is going on if you have visibility on the API calls.When using a Web app in the browser, you can use tools such as the Network Tab in the Developer tools to capture the traffic and inspect the API calls. You can get more details on how to do this in this post:But what do you do when you get errors in applications (.exe) such as Power BI, for example? For scenarios like this, you can use Fiddler.How to use FiddlerDownload and install Fiddler-Classic  Open Fiddler You need to decrypt tr

Hello Cognite Hub Community!We’re working on a new webinar series where we focus on concrete use case and solve it from start to finish with Cognite Data Fusion. We’d like to hear from you – which specific industrial use cases would you like us to solve? Please give us as much detail and context as you can.Do you have a use case solution you’d be interested in co-presenting with us? Fantastic. Please reach out to me directly on Cognite Hub or by email (eric.stein@cognite.com) and I’ll be in touch.Thanks everyone and looking forward to hearing from you!

Hello Cognite Hub Community!We’re working on a new webinar series where we focus on concrete use case and solve it from start to finish with Cognite Data Fusion. We’d like to hear from you – which specific industrial use cases would you like us to solve? Please give us as much detail and context as you can.Do you have a use case solution you’d be interested in co-presenting with us? Fantastic. Please reach out to me directly on Cognite Hub or by email (eric.stein@cognite.com) and I’ll be in touch.Thanks everyone and looking forward to hearing from you!

I had the pleasure of attending the Connected Manufacturing Forum, hosted by Worldwide Business Research (WBR), in Atlanta, Georgia this past June. The event brought together leaders representing various fortune 500 manufacturing companies to discuss challenges, initiatives, and opportunities surrounding connected manufacturing.One key insight I gained from the event is that manufacturers in continuous process, batch, and discrete manufacturing are understanding the challenges associated with making sense of the vast amounts of data generated across IT, OT, and Engineering, which is the industrial data problem. Accessing and contextualizing data across varying source systems is key to realizing the value of the data and is a prerequisite for generative AI capabilities (LLMs).This is the exact problem Cognite solves. Now having just launched Cognite AI and Industrial Canvas, Cognite now enables manufacturers to rapidly embed AI-powered algorithms into operational workflows.Cognite AI is

 Below we have outlined several frequently asked questions and their corresponding answers.Don’t see the answer to your question? Post as a reply in this thread and we’ll be sure to answer and/or add it to the FAQ list below!Protip: Use [cmd+f] or [cntrl+f] to search for keywords related to your question. FAQs How do I access the documentation for monitoring in CDF?You can access the documentation for the new monitoring solution in CDF here: https://docs.cognite.com/cdf/charts/#monitoring.   Where do I go to access monitoring and how do I use it ?You can find the instructions by watching this short video here:   

Have a feature request or idea for a new and improved functionality?Then we’d love to hear all about it! We’re constantly working to improve the monitoring product experience.You can choose to either create a dedicated post (topic) in this group by clicking the Create topic button or simply post a reply below in this thread. Remember to say whether your feature request is Nice to have, Important, or Critical to you and why. Screenshots, sketches, or explanatory videos are also encouraged.

When creating Labels, the “external_id” and “name” fields are switched. I’ve previously reported this for C#. It turns out the error is also found in the Python SDK:Repro stepsReplicating the bug is trivial. Consider the following code in Python:label = LabelDefinition(external_id=”label_x”, name=”x”, data_set_id=DATASET_ID)client.labels.create(label)Use the label on an asset, and CDF will display “label_x” as the label name. The two fields are somehow swithced.Persistance or display issue?Ok, so is CDF just displaying the wrong field? It’s hard to tell due to other issues around labels, but consider this: As a fix, I chose to align the “external_id” and “name“ fields, landing on the something like this.:label = LabelDefinition(external_id=”x”, name=”x”, data_set_id=DATASET_ID)client.labels.create(label)Resulting in an errorCogniteDuplicatedError: Duplicated: [{'externalId': 'x'}]The API Failed to process some items.

Need to work on POC where cognite data fusion timeseries can be added as dataset/data source in Azure MLopsIs there any way if this is possible

 Industrial Canvas is the digital workspace for data-driven planning, collaborative data analysis, troubleshooting, support for root cause analysis, operational insights, work pack preparation and even collaborative maintenance planning. It gives industrial teams simple access to complex industrial data, in their language and on their terms. This first-of-its-kind experience for industry allows experts to go from cumbersome manual workflows to a visual, collaborative interface powered by contextualized data and artificial intelligence.With Industrial Canvas, Cognite Data Fusion provides a blank canvas for subject matter experts to creatively think, build, and work with industrial data from all sources. Here are a few examples of what you can solve in a canvas by working collaboratively across several data types: Pulling in all the relevant data when performing a root cause analysis on an anomaly such as loss of containment in a compressor.  I got a well failure, now I can extracted all

Simply ask your Cognite Representative to set it up for you and Industrial Canvas will appear in the Cognite Data Fusion menu.   

We are happy to announce the release of our groundbreaking Industrial Canvas in Cognite Data Fusion where you can easily:Explore and access any type of data in one compostable environment. Work with several data types side-by-side and get all the context that you need for your data analysis.  Collaborate - annotate, share insights with seamless integration into no-code analytics (Charts). Working together, in the same canvas, with your fellow colleagues to solve problems and iterate. Create - work in a canvas like experience, get documents summarization, flexibility on how you are managing the space and find solutions based on data. By having a collaborative workspace, you can do visual data exploration to efficiently analyse a problem or understanding something about the physical asset and the data it is generating. You can perform data analysis, troubleshooting, support for root cause analysis, understand your asset health, do work packs preparation, support for maintenance planning

Dear Cognite Hub community: We are very happy to announce that our Cognite SAP Extractor is now generally available to CDF users!The extractor connects to OData V2.0 endpoints in the SAP NetWeaver Gateway, making use of many pre-built integrations available in S/4HANA and saving considerable implementation time, while also natively connecting to the SAP data you need in a standardised manner.To get started,  download the SAP Extractor from the “Extract Data” page directly from CDF. The documentation, including Server Requirements and how to set up your SAP extractor is available here.We have also prepared a short demo (less than 4 minutes long) showing the steps needed to setup a data extraction from SAP S/4HANA OnPremise to CDF from scratch, including how to find the standard service from SAP, enable it in S/4HANA, configure and run the extractor and then see the SAP data in CDF.   Any feedback is very welcome, after testing the extractor and/or watching the quick demo please make sur

Subscribe to webhookhttps://status.cognite.com reports the health of Cognite's services and products. You can sign up to get email and SMS notifications for status changes and upcoming maintenance for specific products and clusters. You can also subscribe to webhook notifications to integrate with your monitoring systems. You will receive notifications for all components and clusters and can filter the information to fit your needs. To subscribe to webhooks, select "Subscribe to updates" and then the webhook option (<>). Specify the URL we should send the webhooks to and provide an email address if your endpoint fails. The table below lists the product IDs you can use to filter the notifications. For details about the format of the notifications, see https://support.atlassian.com/statuspage/docs/enable-webhook-notifications/ . If you don't know which cluster your CDF project is on, contact Cognite Support or Customer Success. Cluster names and product IDsIf you're subscribing to

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times.Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times. Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Hello everyone! I am Elias, robot enthusiast and Product manager for Robotics and field operations. Join us for the Asset Performance Management Product tour and discover how you can enhance your understanding of your assets while leveraging Cognite's offering to boost your uptime.Watch the recording here: We're eager to hear your thoughts on how robotics can play a role in Asset Performance Management. Share your ideas in the thread below! 🚀

[TL;DR]Cognite introduces user profile functionality to collect user information such as name, email, and job title for all CDF users to improve search and sharing capabilities. Administrators can, of course, disable the automatic collection of user information. The functionality will enable us to provide you with granular access controls, collaboration features, and much more in the future. Initially, we support user profiles for projects using Azure AD for authentication. We will add other identity providers later. For more information about how we handle your data, refer to our privacy policy at https://www.cognite.com/en/policy.- Cognite Product TeamAt Cognite, we strive to provide a seamless and efficient user experience for all our users. To achieve this, we have rolled out user profile functionality and started collecting user information, such as name, email, and job title, for all Cognite Data Fusion (CDF) users. This will enable Cognite, 1st-party, and 3rd-party application b

We are happy to announce that Flexible Data Modeling is released in general availability in the April release. The stability and set of features is at a good state, but will of course be improved over the next months. The early adopter group will then be closed, and all content will be moved into the open community here on Hub.

Would you like to develop an end-to-end, production-ready solution with Cognite Data Fusion? We have a new training for you!The new Cognite Data Fusion Delivery Bootcamp is an intensive 5-day training program focusing on a complete deployment, combining the different steps with DevOps best practices from CDF bootstrapping to solution deployment, monitoring, and operations.Each day explores a different step of the deployment:Day 1: Configuring Cognite Data Fusion and the Azure Active Directory to set up access control. Day 2: Data creating pipelines and integrating data into Cognite Data Fusion. Day 3: Running integrations and calculations in Cognite Data Fusion. Day 4: Transforming and contextualizing data. Day 5: Unlocking the value of data and solving a use case by visualizing data.You can now preregister for the bootcamp on Cognite Academy, where you will find the available dates and an information package.Preregister for the bootcamp on Cognite Academy.Learn more about the bootcamp

 Exciting News!  We are thrilled to announce the launch of a remarkable customer story featuring Aker BioMarine and their incredible journey with Cognite Data Fusion. We invite you to dive in and take a look at the incredible results they achieved! In a nutshell, here are some impressive highlights from their collaboration: 3 million data points were contextualized, unlocking valuable insights and driving informed decision-making 56% reduction in unit cost of operation within just two years, demonstrating the power of optimized processes and data-driven strategies A remarkable 73% reduction in downtime due to improved operations, ensuring maximum productivity and minimizing disruptions2x increase in output with the implementation of cutting-edge machinery, taking their operations to new heights!Want to explore this inspiring success story in detail? Don't miss out on the opportunity to learn more. Simply visit the link below to access the full story:  Link to the Customer Story: Aker B