Community Discussions

Hi Team,It would be a good use case to add sequences and SimInt outputs to be added to Canvas since well logs are stored as a sequence in cdf.Also, SimInt outputs are stored as time series outputs. It could be useful to include these as well.Thanks,Akash

 Check out our new comprehensive course on Cognite Data Modeling which is a new addition to the Data Engineer Basics - Transform and Contextualize learning path.In this course, you will learn fundamental concepts, practical applications, and advanced techniques for effectively organizing, querying, and managing industrial data. Whether you're new to data modeling or looking to deepen your understanding, this course will equip you with the knowledge and skills to harness the power of data modeling in Cognite Data Fusion (CDF).Key Concepts:The course covers essential concepts of Data Modeling, such as Data Models, Spaces, Containers, Views, and Instances, as well as its public REST and GraphQL APIs.For a limited time, you can access this course for free. Use the code datamodel-qzb8pin9ukz2w upon registration to the Data Engineer Basics - Transform and Contextualize learning path until 31 March 2024. You can also access five additional courses in the learning path, along with the exam to

Hello everyone.I have a use case that I have been trying to figure and I'm hoping you could help me.We have an equipment, let's say a pump, and we have a timeseries for its flow. We consider that the pump is operating as long as the flow is above a threshold.In PI, if I want to know how long the pump was operating, I can simply use PITimeFilterVal function in Excel to retrieve the amount of time that the timeseries was above the threshold. Me and my team have been trying to do this with Cognite, with no success. We tried transforming the timeseries to a 0 or 1 using the “Threshold” function, and then integrating it, but we have faced some limitations due to the approximations that are intrinsic to the integration function.Unfortunately, I cannot show you the actual data, be we checked a few days where the pump starts the day operating - at 00:00 - and at 2 am our integration gives us a value of 1.84h - when it should be as close as 2h as possible. This difference, even though slight, i

Hi all!Data Workflows (re-named) is now in Public Beta, as part of the latest release of Cognite Data Fusion. See the Product Release Spotlight post for more information.We have also added a new feature for subworkflows which you can read more about here.You can find updated documentation at Cognite Docs and Cognite API spec, replacing all earlier versions. Note that the user interface in Fusion remains in Alpha pending the development of a new version. If you lack access to the user interface, get in touch with a Cognite representative or leave a comment below.Let us know if you have any questions or comments!

Hello group members, “If you were to use CDF as an Industrial Historian, what features relating to versioning, tracking of changes and auditing would you need from our Time Series API”.In an upcoming release, we are planning to introduce support for versioning on Time Series, with the intention to enable our Time Series service to be used in the same way as you would a traditional industrial Historian.I am keen to gather information and insights from you to understand the scenarios where such a capability is required, in order that we build the right thing.  Please feel free to send me a direct message if this is of interest to you!Kind Regards, Glen

If you are one of those, who either have a big vision of maintenance transformation or are working on optimizing one part of the maintenance management process, here is a suggestion on how to optimize to meet ambitious OPEX reduction goals while building sustainable and integrated Maintenance management processes. My name is Aleksandra, and I am a maintenance domain expert in Cognite. Together with my colleagues, we have a mission to empower the maintenance ecosystem with the data and technology so maintenance professionals can efficiently optimize and transform their underlying and fundamental maintenance management processes. Here are some tips on building with the end in mind and avoiding optimization in silos. Optimize using data from multiple systemsMany companies these days are busy with the optimization of their maintenance strategy for equipment and moving it from calendar to condition-based maintenance (CBM), where possible. One way of doing it is to use a centralized conditio

Hello everyone in the group!I’m delighted to announce that in the upcoming release, the Time Series Subscriptions feature will mature to a Generally Available level of maturity.  But…!  The feedback does not stop there.  Please do continue to use this group to ask questions about the feature, request improvements or provide any other form of feedback.In light of the news, I also feel that this group in its current form has served its purpose.  However, we would like the group to continue as we appreciated your engagement on our product developments.  Therefore, we would like to repurpose this group to cover more topics and features relating to the Time Series API, and our other OT services too, such as Events.We hope you continue to be members of the group, and look forward to collaborating with you with our future developments, and thank you so much for your contributions in bringing the Subscriptions feature to GA! 

There’s an issue if you create a label and delete it as you might not be able to reuse the same external_id ever again. Even if you first delete the asset or relationship that the label is conected to first and then delete the label, you end up with a ghost label. With some random exceptions(say in 1 of 15 cases it’s not an issue). It feels like a cache issue, but as we’ve seen over the last half a year or so, the issue seems to persists over several months.For this example I’m using an empty dataset, I’ve created a label, tied it to an asset, deleted the asset and then deleted the label. The external id I’ve used for my label are now locked forever. I then try to create the label, if not found: Resulting in an error This is a bug across the C# and the Python SDK.

Hi everyone,Happy to share with you our latest features in Industrial Canvas:New features:While exploring data in Data Explorer you can now easily add any item (asset, event, 3D model etc) to a Canvas.   The entire canvas can be exported in a PDF, including the annotations. You can now customize which info/fields are relevant to you, when adding an asset or event to a canvas.      You can duplicate a canvas and copy-paste items from one canvas to another.   You can now change the order/layering of items in the Canvas. You can draw markups using the line tool when holding CMD. Several styling and bug issues have been fixed and tweaked.  Give it a try and share your feedback with us :) Thank you!

Hi Everyone,In case you haven’t discover them yet, I would like to share with your what brings January release as new features and capabilities in Industrial Canvas:Working with dataBetter visualization quality while working with time series and files. When exporting a canvas in a PDF we have eliminated the blank pages and the annotations are visible in the PDF as well. AI semantic document search Ask questions in natural language and get answers based on information found in a document. Verify answers by jumping to location of source in the document. Interpret information found in the document based on questions.CollaborationWhen I’m being tagged in a canvas, I’m getting notified via email.  Keep up to date with all your canvas versions, restore to an older version and lock a canvas for preventing changes from happening.ToolboxEnriching the toolbox with more tooling such as Industrial shapes and export your canvas in a PDF.Looking forward for your feedback!

Is there any use cases available and/or documentation with examples about configuring the PI extractor?I have found the documentation available in the web lacks information with more robust examples.Also some of the videos i have seen so far are very very basic that seemes a waste of time to watch cause they can be resumed in one phrase cause they briefly tells you what the extractor do but they dont tell how to get it to work which is what we need as engineers, a step by step guide with better examples, using fictionary data and examples could be a good starting point so we can just follow up the guides and set up instead of being crating a lot of tickets which would be reserved for troubleshooting, etc. Thank you,

I would like to make you all aware of a new tool that is now in beta: The CDF Toolkit. The toolkit comes as a python package with a CLI tool, cdf-tk, and a set of templates that can be deployed to your CDF project to get started. This initial version is focused on Infield deployment, but can be used for any type of CDF project to manage your CDF configurations and resources as code. Head over to the beta group to check out the latest small demo videos we added and test it out!

Hei Dear CDF usersAre you a user using charts for data science purposes / tasks or an active user of python code / jupyter notebooks ? We would love to talk to you as @Lars Moastuen would like to better understand your needs and current workflows. The team is currently working on a jupyter notebooks integration with charts and would like to better understand the needs there. Please feel to comment in the thread below if you are an user using charts for these purposes.

Hi, I'm Iñaki and I've been in the digital industry for more than a decade learning and helping customers in their Digital Transformation journey.For industries like Oil and Gas and Manufacturing it feels like I’m embarking on an adventure with every customer having its own unique complexities. But it's the constant mix of challenges, opportunities and excitement that keeps us all on our toes and motivates me. These industries are all about growth and staying in the game, and they know that embracing the digital era is the real deal.Over at Cognite, we're all about guiding organizations through this wild digital journey. Our expertise? Well, it's a combo of what we've learned from our customers and our deep dive into industry best practices. It’s like putting together a puzzle when it comes to integrating all kinds of data into these massive data lakes. Is it complicated? Yes, but it’s worth it.To really unlock the full potential of digital transformation, industries need to dig deep t

Hello CDF developers and users,Following feedback about the best practice examples provided in the documentation for how to use Parallel Retrieval / Partitions, Cognite has updated its documentation to make more explicit the limits in place for how many partitions that can be used in a request.  The document now makes explicit that a maximum of 10 partitions is supported.This guidance is found in the Pagination section of the Developer GuideIn conjunction with the updated guidance, limit enforcement will be put in place on the Assets, Events and Files APIs, to ensure predictability of performance with these APIs, effective from 1st February 2023.  Requests calling for more than 10 partitions will return a HTTP 422 ‘Unprocessable_Entity’ error message.  Similar limits will be rolled out across all CDF backend APIs, and details of these limits will be provided in their respective resource type descriptions.For any existing client applications that are calling more than 10 partitions, the

Hi! We’re aiming to monitor all of our CDF operations in the solution we have for monitoring other systems and data flows (Splunk). This would involve monitoring of extractors/extraction pipelines, cognite functions, and general platform availability. I wonder if any other Cognite customers have done this, and if you would be willing to share your experience / architecture for extracting logs from cognite functions etc. into Splunk or a similar service? Cheers,Kristian 

While testing the hosted MQTT extractor and the pre-release front end I have noted a couple of things you might be interested in, but I’m also guessing some of these are quite obvious to you and already in the pipeline. Front end should support creating a new destination with specified dataset. Viewing and editing a stream transformation without deleting and creating a new one would be nice. A way of listing existing transformation mappings and create or draft new ones without setting up an extractor instance for it would be helpful. Transform error-messages might not point at correct line and character in the message it returns. I don't have an example of this right now, I will post one if I see it again. Transformation Mappings entity could have a description-attribute that lets users describe the scenario it is written created for. The endpoint listed in beta docs for creating destinations did not work, I ended up using the same endpoint as the front-end where "hostedextractors" is

Happy to share with the Digitalization community some security news!Since Cognite's start, we have prioritized security and take our security role very seriously as a partner to mission-critical industries. Today, I am happy to announce that Cognite has obtained our SOC 2 Type II certification. The American Institute of Certified Public Accountants (AICPA) bases SOC 2 engagements on its Trust Service Criteria. These criteria ensure we have rigorous security guidelines and stick with them. Type II certifications, in particular, are comprehensive and involve significant work to prepare, so a huge thank you to our team and our partners for their contribution to this achievement. At Cognite, we are investing in more automated ways to support continuous compliance monitoring.  We focus on empowering our end users with industrial data operations without managing the related infrastructure. We believe it's our mission to create frictionless security, and our SOC 2 Type II certification is ano

Dear Power and Renewables community members,We're evolving! The Power and Renewables group is closing, but exciting new groups are on the horizon. We'll be launching early adopter groups for our power and renewable industry domain specific offerings.Don't worry about losing valuable content - everything shared here will be available in our community knowledge base. Stay tuned for invites to our early adopter groups, and in the meantime, we hope you'll continue the discussions with everyone in our broader community. Thank you for being a part of the Cognite Hub Community. Your expertise is essential, and we're eager to continue the journey with you in our community spaces.Best,Ingar Beck Landet, VP Power & Renewables in Cognite

Hi everyone,We are working on a new project related to video analytics and would like to know if there are any features available at Cognite that we can count on as possible components of the solution, such as Cognite Cluster for running object detection/classification, object tracking, partial video events, and overlaying video output.

Hi all!This is an update from the Data Modeling team on an upcoming change.We are making a change in how we treat the absence of data in an object when making a query in a data model graph. Currently, if an instance has no value in an optional property, it will not be included in the response to a query for instances where that property is NOT some value.As an example, consider a field “completionYear” which is not always populated - a query for instances where completionYear is NOT “2023” would return only instances where completionYear has a value, and that value is not 2023. Instances where that property is not set would not be included.We intend to change this behavior such that instances without a value in that property would be included in the query reseponse, as this behavior is more in line with the expected behavior in most cases. This also resolves an inconsistency with the search and aggregation queries where this behavior is already happening.We consider this a bug fix, so

Hi! We have made the following updates available for Workflows.Optional TasksDefining non-critical tasks in a workflow as optional, meaning that in the event of a task failure, the workflow itself should continue, has been a much requested feature. You can now set the policy for how to handle failures and timeouts for each task in a workflow. By default, the workflow will fail if a task fails (after retries) or if the task times out. Alternatively, you can set the parameter to skip the task in the event of a failure or timeout (after retries). This means that the workflow execution will continue even when the task does not complete successfully. The feature is documented in the API specififcation here (navigate items > workflowDefinition > tasks > onFailure). Concurrency Policies for TransformationsIf a job is already running for a given Transformation in CDF, a new job cannot be started concurrently (fails with error message “A job already runs for this transform”). To better

Hi Community Members!We’ve recently published a cloud-based Virtual Flow Metering (VFM) system tailored for a late-life well with high water cuts. This solution employs a hybrid physics-data approach, delivering precise and near-real-time estimates of water production per well in gas fields.Link to the full article: https://www.sciencedirect.com/science/article/pii/S277250812300042X Enhancing Production OptimizationIn the oil and gas production domain, understanding the fluid composition and production rates of multiphase operations is crucial for effective planning and optimization. With wells yielding a diverse mix of oil, gas, and water, often with varying compositions, ensuring accurate measurements is essential for maximizing production efficiency. Ratios change in time, and this gets more and more important as the water cut grows in the late part of a water flooded well life. This article explores how Virtual Flow Meters (VFMs) offer a cost-effective alternative to traditional me

Hello everyone,I'm relatively new to using Grafana, and after reading this post (Cognite Hub) on Cognite Hub, I've come to understand that Alerts in Grafana may not be compatible with the CDF connector. Please feel free to correct me if I'm mistaken.Considering this, I'm wondering if anyone has a good setup for monitoring the data coming from the CDF connector. I have around 900 time series, and listing all of them is not very efficient. Additionally, I'm having trouble figuring out how to write an SQL query to count the time series that have a timestamp older than, let's say, 3 hours. this could be a way, to count data not coming in. Would anyone be willing to share their setup or offer any tips?Thank you in advanced :) 

In September, we embarked on an incredible journey with our partners at CNTXT Academy, bringing Cognite Data Fusion (CDF) training to the heart of Saudi Arabia. We were thrilled to host not one, but two engaging Cognite Data Fusion Fundamentals sessions right at the epicenter of innovation - Saudi Aramco's headquarters in Dhahran. Our participants came from diverse backgrounds, each with their own unique experiences with Cognite Data Fusion. So, we tailored the training to ensure it resonated with everyone, addressing their everyday work challenges that Cognite Data Fusion can brilliantly solve.The first part of the training focused on contextualization, mastering Cognite Charts, and seamlessly connecting CDF with Grafana to tackle a real-world use case. The participants got hands-on experience, putting their newfound knowledge to the test right in CDF. In the second part, our exceptional instructors introduced participants to the Cognite Python SDK, taking their skills to the next lev