Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
Is there a way of dividing a time series in Grafana over say 7 days into separate predefined time intervalls (e.g. 1 day) without aggregate the data in the time series over 24 hours? I guess what I am looking for is to create 7 different queries for the same time series over a defined time range (7 days) in Grafana, defined for each day in that time range, and then find the difference between the first and the last data point in each query for the specific time series.
Hello, I found very interesting that a lot of the conversation around digital has moved away from “AI will change the industry” to much more elaborate analysis on the importance of data in context and data orchestration/DataOps. This realization is making its way all the way to the board room.A good example comes from the recent conversation between Blake Moret (CEO of Rockwell Automation) and Olivier Le Peuch (CEO of SLB). Both companies have independently decided to partner with Cognite and you can find some of the rationale in their exchange below.Two additional notes from the discussion:There is a vision to move from an equipment centric digitalization to a full asset/system view of what digital should encompass - with automation/closing the loop as a key actuator (see Sensia’s control systems’ role), The discussion around optimization has stopped being solely about production volumes but now also systematically includes carbon. Source: Partial transcript from Rockwell Automation'
We’d love to hear from you already now with your questions and expectations for the Cognite Live Product Tour 2023 that will take place March 30th! Let us know your thoughts in this thread 🚀 If you haven’t already signed up, you can do so here. Looking forward to hearing from you and hope to see you there!
I was trying to complete the Cognite fundamental modules. I am getting the below access denied error only while doing the last 3 labs. Could you please assist for the same?
Does Cognite CDF have a standard PowerApp connector read/write? if not can we build one.
If you are curious on how to get the most out of your Cognite Data Fusion subscription, you have come to the right place. This is part of a series of posts where we share some of our experience from working with customers in their journey towards an Industrial DataOps organization. We want to share lessons learned, mistakes made, good practices observed, and observations of pitfalls and risks. This is not the absolute truth, but hopefully a way to spark good discussions around an inherently complex topic! To quickly introduce ourselves, we are @Arjo Oosten, Digital Transformation Leader, wintersport addict and passionate about driving hands-on digital growth strategies and value based decision making, and @Karolina Luna, Solution Architect, cat lover, and passionate about the lifecycle perspective of everything (like solutions and data products). To learn more about Cognite Data Fusion, we recommend this post. DevOps and Industrial DataOpsBoth DevOps and DataOps have many different def
We have been discussing with one of our customers the need for a course, similar to the excellent Cognite Data Fusion Fundamentals course, but with less of a technology slant. It would be great to hear your thoughts on this and any topics you think this should cover.
Hello All,I am trying to query the FDM schema after populating (listForecast in slb-pdf project). But i am getting the error! seems like an bug. Can you check if I am doing something wrong.query MyQuery { listForecast(filter: {oilRate: {eq: 1.5}, and: {gasRate: {eq: 1.5}}}) { edges { node { id } } }} Error I am getting is as below. Can you help if known bug or if I should do differently? "message": "Expected either 'and', 'or', 'not' or a single field condition used in the same filter block.",
The Cognite Live Product Tour 2023 is just over a week away! This event is our annual showcase of Cognite Data Fusion functionalities – both those that will be released in our upcoming December 6th release, and looking ahead at what is to come throughout the new year. We’ll be driving a discussion with you – our community – about Industrial DataOps and the value of empowering Subject Matter Experts in the industrial organization. We hope you’re looking forward to the event as much as we are! Below is an outline of some of the exciting topics we’ll be discussing. WATCH THE COGNITE LIVE PRODUCT TOUR 2023 RECORDING INDUSTRIAL DATAOPS AND THE SUBJECT MATTER EXPERTIndustrial DataOps is about breaking down silos and optimizing the broad availability and usability of industrial data. Learn about why we are focusing on enabling the Subject Matter Expert throughout 2023 and the two main challenges that SMEs in every industrial sector face. COGNITE DATA FUSION: HIGHLIGHTS OF OUR DECEMBER 2022
If you are curious on how to get the most out of your Cognite Data Fusion subscription, you have come to the right place. This is part of a series of posts where we share some of our experience from working with customers in their journey towards an Industrial DataOps organization. We want to share lessons learned, mistakes made, good practices observed, and observations of pitfalls and risks. This is not the absolute truth, but hopefully a way to spark good discussions around an inherently complex topic!To quickly introduce ourselves, we are @Arjo Oosten, Digital Transformation Leader, winter sport addict and passionate about driving hands-on digital growth strategies and value based decision making, and @Karolina Luna, Solution Architect, cat lover, and passionate about the lifecycle perspective of everything (like solutions and data products). To learn more about Cognite Data Fusion, we recommend this post. Outsourcing FTW?As many companies have found, it can be hard to attract the
In grafana, we want to display total of all timeseries data-points for all assets connected to particular asset for which we are passing query like this:ts{assetSubtreeIds=[{id=$Org4}], name='oil-production-rate'}where value of $Org1 is coming from dashboard variable.and since cognite grafana plugin does not handle cursor api responses and synthetic timeseries api have some limitation in returning 10k records only in a request, to reduce number of data-points, we are trying to use aggregation: ‘sum’ and granularity: ‘30d’ since there could be more than 10k data-points. But its is throwing error saying “sum” is not valid aggregation type of synthetic timeseries. Any reason why “sum” aggregation is not supported for synthetic timeseries.(screenshot attached)
Hi, I am currently doing my Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course. while executing the notebooks, getting below error with the first “List” notebook even after successful Cognite client authentication.CogniteAPIError: Resource not found. This may also be due to insufficient access rights. | code: 403 | X-Request-ID: 52b3d730-caea-9d32-bfc4-649041e43c3e Note: I am not using Poetry as I am not getting option to change Kernel in my Jupyter.
If you are curious on how to get the most out of your Cognite Data Fusion subscription, you have come to the right place. This is part of a series of posts where we share some of our experience from working with customers in their journey towards an Industrial DataOps organization. We want to share lessons learned, mistakes made, good practices observed, and observations of pitfalls and risks. This is not the absolute truth, but hopefully a way to spark good discussions around an inherently complex topic!To quickly introduce ourselves, we are @Arjo Oosten , Digital Transformation Leader, wintersport addict and passionate about driving hands-on digital growth strategies and value based decision making, and @Karolina Luna , Solution Architect, cat lover, and passionate about the lifecycle perspective of everything (like solutions and data products). To learn more about Cognite Data Fusion, we recommend this post. Knowing which roles you need for your Industrial DataOps organization, as c
Data operations (DataOps) is essential to providing consumers with business-ready, trusted, high-quality data. But when faced with a somewhat different data source, data type, data quality, and data consumer landscape, what are the defining factors that will significantly catalyze DataOps adoption in industrial companies? Join our upcoming webinar with Forrester, and be a part of the discussion, as we unpack the technology behind the DataOps practice. Dive into the topic of data operations for industry and hear leading analysts’ take on:-What is DataOps today? How has it evolved over the years?-How does DataOps adoption affect industrial companies?-What are the challenges when adopting DataOps?-Where do DataOps and MLOps come together? Register here
When I run the query below, I am getting an error. If I increase the end time by 1 second I can get a result, but it gives me 2 days and I only want 1. All my data is consistently daily at midnight, UTC. Any ideas how to get past this?SELECT dp.id, dp.externalId AS `key`, dp.timestamp, dp.valueFROM `_cdf`.`datapoints` dpWHERE dp.externalId IN ( 'f18ae31cbfe544cb7bca08da91e5245a-SuFMiCo0f7c8eca4ce444208853aedd00ded4fb', '730619216b764ba77bc708da91e5245a-SuFMiCo6bb90df0efbc461d863faedd00df009b' ) AND dp.timestamp >= TO_TIMESTAMP('2022-09-01T00:00:00Z') AND dp.timestamp < TO_TIMESTAMP('2022-09-02T00:00:00Z') Gives me a result, but not what I want: cc @Torgrim Aas @Sunil Krishnamoorthy
Sesam.io is a master data hub that simplifies the process of making up-to-date master data available in a data platform architecture.Cognite CDF, well, you all know what is it, right?And we are going to send some data from Sesam to CDF without creating and deploying any connectors, only by using out-of-box functionality provided by Sesam. What we need:Cognite CDF project configured with an Oauth2 identity provider, such as Azure Active directory Credentials such as client id, secret, oauth token url and scope with access capabilities that allow us to write to Raw tables Provisioned Sesam node with some data.First login into our Sesam instance and create an endpoint system we will use to send data through (I assume you already have some data you want to send to CDF) by choosing “Systems” in left-side menu and then “New system” on the top bar . We will use REST API and push data by making HTTP requests towards CDF. Sesam provides built in REST connector that supports basic and Oauth2 au
If you are curious on how to get the most out of your Cognite Data Fusion subscription, you have come to the right place. This is part of a series of posts where we share some of our experience from working with customers in their journey towards an Industrial DataOps organization. We want to share lessons learned, mistakes made, good practices observed, and observations of pitfalls and risks. This is not the absolute truth, but hopefully a way to spark good discussions around an inherently complex topic!To quickly introduce ourselves, we are @Arjo Oosten, Digital Transformation Leader, winter sport addict and passionate about driving hands-on digital growth strategies and value based decision making, and @Karolina Luna, Solution Architect, cat lover, and passionate about the lifecycle perspective of everything (like solutions and data products). To learn more about Cognite Data Fusion, we recommend this post. Different types of cross-functionalIndustrial DataOps, like all other Ops mo
TL;DRIf Jetfire CLI self contained packages or Jetfire docker image is used in your deployment pipeline. Please refer to the documentation below on how to make the necessary changes to migrate to new Transformations CLI. If not, then no action is required from your end. We have handled it for you! :)) As our services mature, we sometimes need to deprecate the tools and services we made earlier. Last December, we released Transformations API with that came great documentation, support in the Python SDK, and a brand new Python-based Transformations CLI for use in CI CD pipelines.The new Transformations CLI replaces the (old) Jetfire-cli, which will no longer be maintained and will eventually be deprecated at the end of December 2022. The new Transformation CLI supports everything the old Jetfire CLI did and more. It is easier to install, and you can still use your existing Transformations scripts with the new CLI with the legacy mode enabled (Refer migration guide below 👇 ).Like with a
“Data has no value unless the business trusts and uses it” There is no shortage of data in any industrial company, but there is a general lack of understanding on how to extract it, bring it together, and use it in an actionable way.There are two discomforting truths within digital transformation across our key industries; energy, utilities, and manufacturing: Digitalization PoCs are commonplace. Real ROI isn’t. Billions are invested in cloud data warehouses and data lakes. Most data ends there, unused by anyone for anything. At the heart of this data-driven value dilemma lies a confluence of challenges, ranging from the technical (How can we best organize our diverse and fluid data universe?) to the operational (How can we create new information products and services?), to the financial (How can we treat data as an asset?), to the human (How can we improve data literacy and ensure digital solution adoption in the field?).With more and more of our industrial operations data readily
In the TNT application at Statnett we are seeking to collect line and point geospatial features through the FeatureAPI. We have a dataset that has been populated with data about powerlines and substations, and we want to query the client for all of the features in each of these seperately. As there is no list() method in the FeatureAPI, and the search method is limited to 1000 results, we try to do this using the searchStream() method. Our query looks like this:client.geospatial.feature.searchStream('ACLineSegment', { limit: 10000, output: { jsonStreamFormat: 'NEW_LINE_DELIMITED' as const } }); This seems to work fine for the ‘ACLineSegment’ features but when i replace it with ‘Substation’ the call returns an empty string. I’ve tested with the regular search() and this returns features so I would expect the searchStream method to find these as well. Even stranger is that i quickly tested this functionality before the weekend and it seemed to wor
I get the following warning every time I create a CogniteClient: ResourceWarning: unclosed <ssl.SSLSocket fd=5, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=6, laddr=('10.xx.xx.xx', 49572), raddr=('40.xx.xx.xx', 443)> Is this caused by the connection handling in Cognite SDK? I’m using the following Python modules:cognite-sdk-4.11.0cognite-sdk-core-2.56.1
We proudly announce that Flexible Data Modeling has reached public beta. Flexible data modelling in CDF enables you to model industrial data the way you understand it in a self-documented way so that domain experts can find, recognize and understand the data without a third-party manual.pdf. Your data is stored in one single knowledge graph, and empowers users to search, filter and aggregate data according to their needs through various data models on top of the knowledge graph. Flexible data modeling enables rapid scaling, whether it is building an app, data science model, dashboard, or other use cases, we hope that this capability can be a great toolkit in helping you to express data in the most intuitive way.In the Beta version you can Create and manage data models in Fusion and using a cli tool Ingest data into the data model using CDF transformations Query data using GraphQL with powerful search and filtering in Fusion or your own applications with even more powerful features
Hi there, I’m new to Cognite in general, but one task that my team is looking into is utilizing Cognite’s SVG files in our LCI and Plant Management applications and I have been looking into it somewhat.Not knowing all the details of the SVG rendition capabilities, I do see that our customer ‘Interactive P&IDs’ dataset in CDF has SVGs renditions without the comments that are in the PDF files (where applicable).Would Cognite be able to include the comments - now or in the future?The reason this is relevant for us is that a number of our doc profiles only have PDF files. Typically old documents on old installations.We’re missing native files (DGN, DWG), thus contractors are updating these drawings using comment features such as clouds, text, lines, etc in Adobe. That information seems to disappear in SVG renditions, but it’s quite critical information, especially in Plant Management systems. Thanks for listening to me!Best regards,Erik
Developing, tracking and meeting sustainability goals is becoming increasingly important for companies in the public sphere. Many of them are turning to data-driven solutions to help them monitor, report and reduce their environmental impact. Recent regulations in Europe recognises that Data-driven solutions for GHG emissions reductions are contributing to climate change mitigation (see official site from the European Commission - link) At Cognite, we have encountered many innovative solutions that promote sustainability. Examples include: Automating the recording and reporting of greenhouse gas emissions in industrial processes. Optimizing energy efficiency at the equipment and system level to minimize scope 2 emissions. Using robotics to detect dangerous leaks. Leveraging operational data to derive the environmental footprint of discrete products. Protecting biodiversity with the automatic detection of birds close to onshore windmills After analysing dozens of those solutio
I have found a problem reading timeseries from Cognite with Power BI. The first bit of Power Query has a filter to limit the timeseries retrieved to just the ones I want. The second one is the same, but does not have the filter. What I have found is that adding the filter causes duplicate rows in the table. Once the timeseries rows are duplicated, the timeseries aggregation values are also duplicated. I know that the first query is not the most performant option, but it should still have the correct answer.let Source = Cognite.Contents( #"cogniteContentsParameters", #"cdfEnvironment"), Timeseries_table = Source{[Name="Timeseries",Signature="table"]}[Data], #"Filtered Rows" = Table.SelectRows(Timeseries_table, each ([IsString] = false)), #"Removed Columns" = Table.RemoveColumns(#"Filtered Rows",{"MetaData", "SecurityCategories", "IsStep", "DataSetId", "CreatedTime", "LastUpdatedTime", "Asset", "Latest", "DataPoints", "StringPoints", "Aggregate"}), #"Filtered Rows1" = Tabl