Community Discussions

Hello Community Members,I am delighted to announce that from today, the Cognite Python SDK now has support for Time Series Data Quality Status codes.Using the SDK, you may retrieve data points including their status codes, and filter on status codes if desired. You may also insert data points with status codes.For a full description of all the methods and functionality, please refer to the Python SDK Documentation and our Developer DocumentationWhilst this functionality remains in Beta maturity, we are targeting the upcoming June release for General Availability. Cognite relies on customer feedback as key part of its product maturation process, and customers are warmly encouraged to begin implementation of support for data quality status codes and to provide the valuable feedback necessary to allow us to make this feature Generally Available.Thank you for your continued support! Glen

December 15th 2022 - SLB Offices @ Pune, IndiaOn the week of Dec 12th to Dec 16th, Maureen Byrne (Software Engineer), Maria Fonseca (Technical Support Engineer) and me (Data Engineer) travelled to Pune, India, to deliver the first Cognite Data Fusion Bootcamp for eighteen participants from SLB and Infosys. This training delivery marks a milestone for customer and partners of Cognite: this is the first training where Cognite instructors guide them through an end-to-end deployment of Cognite Data Fusion, including data integrations and solution-building.The bootcamp is an intensive 5-day training program that focuses on a complete deployment, bringing the different steps together with DevOps best practices from CDF bootstrapping to solution deployment, monitoring, and operations. Congratulations to the participants of the first bootcamp for gaining their Cognite Data Fusion Bootcamp Certificate!The three of us were very impressed by how fast the participants adopted DataOps tools and pra

1. Field ‘name’ is required during creating data model in CDF.  But it is not required if create through SDK:data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models) 2.  For data models have values in ‘name’ and ‘description’ fields these fields would be cleared up if these parameters are not specified in DataModelApply. These code will clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models)These code won’t clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1", name=”myDataModel”, description=”My Description”)]c.data_modeling.data_models.apply(data_models)To fix make changes in cognite-sdk:Set ‘name’ as required for DataModelApply. Fix clearing values from name and description in D

Hi all!The Cognite Data Modelling product team are looking to make an improvement to how properties from views selected in data modelling graph queries are included in the result data set.The documented and desired behaviour is that only view properties that are explicitly selected in the query will be included in the data output. However, there is a known issue with property selection where in some cases a query would return more properties per view than initially selected.The issue manifests such that properties selected on one view will also be included in the result properties of another view in the query. This behaviour only appears in specific cases: the selection should be in the same table expression, the selection should use two or more views that share some container properties, and one or more shared properties (that is, properties mapped to the same container property) should be selected in one of the views but not in the other.As such, the issue does not cause a data leak

We are pleased to announce that cognite-pygen is available in beta. What does Pygen enable? It enables you to write python-code using the concepts in your data model. The code you can write enables you to query CDF and work with the data in your data model. How? Pygen generates a Python-SDK tailored for your data model. Want to know more? https://cognite-pygen.readthedocs-hosted.com/en/latest/what_is_pygen.htmlDisclaimer! In the beta period, we ask you to be careful when using the pygen generated SDK on a live production project.We would love to get feedback on how to improve the usability and robustness of the pygen. Toward General Availability, we will focus on robustifying the generation process.

Hi everyone,We have great news for you. Our team was working hard to make this happen for this release. We have created a smooth integration and transition between Industrial Canvas and Charts.From now on you can bring your charts to your canvases. You can do it in 2 ways: While in Industrial Canvas, click 'Add data' to open the resource selector and select 'Charts' tab as the fifth option from the tabs. Here you can filter and search your charts, select the ones you want in your canvas like any other data type and shazam! your charts appear in your canvas. While navigating through Charts, select your favorite chart and click the 'Actions' button, then locate Industrial Canvas beneath 'Open In' section. Follow the steps by selecting one of your existing canvases or initiate a new one to add your chart to. With this feature you can fully interact with your Charts from the Industrial Canvas:You can update axis ranges Slide left or right to update time window Use shift to select a speci

Hello everyone! I have several binary timeseries that are displayed correctly when I ask for a short period of time: However, if I ask for a longer timespan, like a year, Charts gives me the aggregates, which I believe would be fine on some cases, but in this particular binary case, it does not make any sense. The final user cannot use this information to perform any analysis; any calculations, thresholds, or just “taking a look to see the trend” will not give an accurate result. Is it possible to choose to disable the use of aggregates for cases like this? Thank you in advance.

Hi Team,It would be a good use case to add sequences and SimInt outputs to be added to Canvas since well logs are stored as a sequence in cdf.Also, SimInt outputs are stored as time series outputs. It could be useful to include these as well.Thanks,Akash

 Check out our new comprehensive course on Cognite Data Modeling which is a new addition to the Data Engineer Basics - Transform and Contextualize learning path.In this course, you will learn fundamental concepts, practical applications, and advanced techniques for effectively organizing, querying, and managing industrial data. Whether you're new to data modeling or looking to deepen your understanding, this course will equip you with the knowledge and skills to harness the power of data modeling in Cognite Data Fusion (CDF).Key Concepts:The course covers essential concepts of Data Modeling, such as Data Models, Spaces, Containers, Views, and Instances, as well as its public REST and GraphQL APIs.For a limited time, you can access this course for free. Use the code datamodel-qzb8pin9ukz2w upon registration to the Data Engineer Basics - Transform and Contextualize learning path until 31 March 2024. You can also access five additional courses in the learning path, along with the exam to

Hello everyone.I have a use case that I have been trying to figure and I'm hoping you could help me.We have an equipment, let's say a pump, and we have a timeseries for its flow. We consider that the pump is operating as long as the flow is above a threshold.In PI, if I want to know how long the pump was operating, I can simply use PITimeFilterVal function in Excel to retrieve the amount of time that the timeseries was above the threshold. Me and my team have been trying to do this with Cognite, with no success. We tried transforming the timeseries to a 0 or 1 using the “Threshold” function, and then integrating it, but we have faced some limitations due to the approximations that are intrinsic to the integration function.Unfortunately, I cannot show you the actual data, be we checked a few days where the pump starts the day operating - at 00:00 - and at 2 am our integration gives us a value of 1.84h - when it should be as close as 2h as possible. This difference, even though slight, i

Hi all!Data Workflows (re-named) is now in Public Beta, as part of the latest release of Cognite Data Fusion. See the Product Release Spotlight post for more information.We have also added a new feature for subworkflows which you can read more about here.You can find updated documentation at Cognite Docs and Cognite API spec, replacing all earlier versions. Note that the user interface in Fusion remains in Alpha pending the development of a new version. If you lack access to the user interface, get in touch with a Cognite representative or leave a comment below.Let us know if you have any questions or comments!

Hello group members, “If you were to use CDF as an Industrial Historian, what features relating to versioning, tracking of changes and auditing would you need from our Time Series API”.In an upcoming release, we are planning to introduce support for versioning on Time Series, with the intention to enable our Time Series service to be used in the same way as you would a traditional industrial Historian.I am keen to gather information and insights from you to understand the scenarios where such a capability is required, in order that we build the right thing.  Please feel free to send me a direct message if this is of interest to you!Kind Regards, Glen

If you are one of those, who either have a big vision of maintenance transformation or are working on optimizing one part of the maintenance management process, here is a suggestion on how to optimize to meet ambitious OPEX reduction goals while building sustainable and integrated Maintenance management processes. My name is Aleksandra, and I am a maintenance domain expert in Cognite. Together with my colleagues, we have a mission to empower the maintenance ecosystem with the data and technology so maintenance professionals can efficiently optimize and transform their underlying and fundamental maintenance management processes. Here are some tips on building with the end in mind and avoiding optimization in silos. Optimize using data from multiple systemsMany companies these days are busy with the optimization of their maintenance strategy for equipment and moving it from calendar to condition-based maintenance (CBM), where possible. One way of doing it is to use a centralized conditio

Hello everyone in the group!I’m delighted to announce that in the upcoming release, the Time Series Subscriptions feature will mature to a Generally Available level of maturity.  But…!  The feedback does not stop there.  Please do continue to use this group to ask questions about the feature, request improvements or provide any other form of feedback.In light of the news, I also feel that this group in its current form has served its purpose.  However, we would like the group to continue as we appreciated your engagement on our product developments.  Therefore, we would like to repurpose this group to cover more topics and features relating to the Time Series API, and our other OT services too, such as Events.We hope you continue to be members of the group, and look forward to collaborating with you with our future developments, and thank you so much for your contributions in bringing the Subscriptions feature to GA! 

There’s an issue if you create a label and delete it as you might not be able to reuse the same external_id ever again. Even if you first delete the asset or relationship that the label is conected to first and then delete the label, you end up with a ghost label. With some random exceptions(say in 1 of 15 cases it’s not an issue). It feels like a cache issue, but as we’ve seen over the last half a year or so, the issue seems to persists over several months.For this example I’m using an empty dataset, I’ve created a label, tied it to an asset, deleted the asset and then deleted the label. The external id I’ve used for my label are now locked forever. I then try to create the label, if not found: Resulting in an error This is a bug across the C# and the Python SDK.

Hi everyone,Happy to share with you our latest features in Industrial Canvas:New features:While exploring data in Data Explorer you can now easily add any item (asset, event, 3D model etc) to a Canvas.   The entire canvas can be exported in a PDF, including the annotations. You can now customize which info/fields are relevant to you, when adding an asset or event to a canvas.      You can duplicate a canvas and copy-paste items from one canvas to another.   You can now change the order/layering of items in the Canvas. You can draw markups using the line tool when holding CMD. Several styling and bug issues have been fixed and tweaked.  Give it a try and share your feedback with us :) Thank you!

Hi Everyone,In case you haven’t discover them yet, I would like to share with your what brings January release as new features and capabilities in Industrial Canvas:Working with dataBetter visualization quality while working with time series and files. When exporting a canvas in a PDF we have eliminated the blank pages and the annotations are visible in the PDF as well. AI semantic document search Ask questions in natural language and get answers based on information found in a document. Verify answers by jumping to location of source in the document. Interpret information found in the document based on questions.CollaborationWhen I’m being tagged in a canvas, I’m getting notified via email.  Keep up to date with all your canvas versions, restore to an older version and lock a canvas for preventing changes from happening.ToolboxEnriching the toolbox with more tooling such as Industrial shapes and export your canvas in a PDF.Looking forward for your feedback!

Is there any use cases available and/or documentation with examples about configuring the PI extractor?I have found the documentation available in the web lacks information with more robust examples.Also some of the videos i have seen so far are very very basic that seemes a waste of time to watch cause they can be resumed in one phrase cause they briefly tells you what the extractor do but they dont tell how to get it to work which is what we need as engineers, a step by step guide with better examples, using fictionary data and examples could be a good starting point so we can just follow up the guides and set up instead of being crating a lot of tickets which would be reserved for troubleshooting, etc. Thank you,

I would like to make you all aware of a new tool that is now in beta: The CDF Toolkit. The toolkit comes as a python package with a CLI tool, cdf-tk, and a set of templates that can be deployed to your CDF project to get started. This initial version is focused on Infield deployment, but can be used for any type of CDF project to manage your CDF configurations and resources as code. Head over to the beta group to check out the latest small demo videos we added and test it out!

Hei Dear CDF usersAre you a user using charts for data science purposes / tasks or an active user of python code / jupyter notebooks ? We would love to talk to you as @Lars Moastuen would like to better understand your needs and current workflows. The team is currently working on a jupyter notebooks integration with charts and would like to better understand the needs there. Please feel to comment in the thread below if you are an user using charts for these purposes.

Hi, I'm Iñaki and I've been in the digital industry for more than a decade learning and helping customers in their Digital Transformation journey.For industries like Oil and Gas and Manufacturing it feels like I’m embarking on an adventure with every customer having its own unique complexities. But it's the constant mix of challenges, opportunities and excitement that keeps us all on our toes and motivates me. These industries are all about growth and staying in the game, and they know that embracing the digital era is the real deal.Over at Cognite, we're all about guiding organizations through this wild digital journey. Our expertise? Well, it's a combo of what we've learned from our customers and our deep dive into industry best practices. It’s like putting together a puzzle when it comes to integrating all kinds of data into these massive data lakes. Is it complicated? Yes, but it’s worth it.To really unlock the full potential of digital transformation, industries need to dig deep t

Hello CDF developers and users,Following feedback about the best practice examples provided in the documentation for how to use Parallel Retrieval / Partitions, Cognite has updated its documentation to make more explicit the limits in place for how many partitions that can be used in a request.  The document now makes explicit that a maximum of 10 partitions is supported.This guidance is found in the Pagination section of the Developer GuideIn conjunction with the updated guidance, limit enforcement will be put in place on the Assets, Events and Files APIs, to ensure predictability of performance with these APIs, effective from 1st February 2023.  Requests calling for more than 10 partitions will return a HTTP 422 ‘Unprocessable_Entity’ error message.  Similar limits will be rolled out across all CDF backend APIs, and details of these limits will be provided in their respective resource type descriptions.For any existing client applications that are calling more than 10 partitions, the

Hi! We’re aiming to monitor all of our CDF operations in the solution we have for monitoring other systems and data flows (Splunk). This would involve monitoring of extractors/extraction pipelines, cognite functions, and general platform availability. I wonder if any other Cognite customers have done this, and if you would be willing to share your experience / architecture for extracting logs from cognite functions etc. into Splunk or a similar service? Cheers,Kristian 

While testing the hosted MQTT extractor and the pre-release front end I have noted a couple of things you might be interested in, but I’m also guessing some of these are quite obvious to you and already in the pipeline. Front end should support creating a new destination with specified dataset. Viewing and editing a stream transformation without deleting and creating a new one would be nice. A way of listing existing transformation mappings and create or draft new ones without setting up an extractor instance for it would be helpful. Transform error-messages might not point at correct line and character in the message it returns. I don't have an example of this right now, I will post one if I see it again. Transformation Mappings entity could have a description-attribute that lets users describe the scenario it is written created for. The endpoint listed in beta docs for creating destinations did not work, I ended up using the same endpoint as the front-end where "hostedextractors" is

Happy to share with the Digitalization community some security news!Since Cognite's start, we have prioritized security and take our security role very seriously as a partner to mission-critical industries. Today, I am happy to announce that Cognite has obtained our SOC 2 Type II certification. The American Institute of Certified Public Accountants (AICPA) bases SOC 2 engagements on its Trust Service Criteria. These criteria ensure we have rigorous security guidelines and stick with them. Type II certifications, in particular, are comprehensive and involve significant work to prepare, so a huge thank you to our team and our partners for their contribution to this achievement. At Cognite, we are investing in more automated ways to support continuous compliance monitoring.  We focus on empowering our end users with industrial data operations without managing the related infrastructure. We believe it's our mission to create frictionless security, and our SOC 2 Type II certification is ano