Skip to main content
  • 238 Product updates

Filter by Topic

Cognite Data Fusion - Introducing live reusable data quality metrics

After we released the first version of time series data quality monitoring, we've seen an unprecedented demand for ensuring that time series data is continuously reliable.It's important for end users of apps and dashboards to know when they can -- and importantly when they cannot -- rely on data to make operational decisions. That means that you as a data scientist or application developer need to communicate to the end user what the data quality status is.You can now easily report live data quality status in dashboards and applications using our data quality monitoring service. The monitoring service creates live data quality metrics, available as time series in Cognite Data Fusion, that you can display in your application -- ensuring that end users know the quality of the data that they are using.Try it out! Learn more in our guide to report data quality status in apps and dashboards.To enable this in your project the service account used by the data quality monitoring service needs to be updated. Go to quality monitoring in Console and follow the instructions on the banner. Note: You need IAM capabilities to do thisBONUS UPDATE: Additionally, you can now efficiently troubleshoot data quality alerts in the app through our updated UI. Quickly see which time series break which rules, explore the historical time series data, and click through to find more details about the data set that the time series belongs to.

Related products:Data Quality

Cognite Data Fusion - April 2020 update

Data sets available in Cognite ConsoleData sets let you document and track data lineage, ensure data integrity, and allow 3rd parties to write their insights securely back to your Cognite Data Fusion (CDF) project.Data sets group and track data by its source. For example, a data set can contain all work orders originating from SAP, or the output data from a 3rd party partner's machine learning model. Typically, organizations have one data set for each of its data ingestion pipelines in CDF.To get started with data sets:Check out our in-depth article to learn more. Navigate to fusion.cognite.com, select Data sets, and follow the steps in our guide to create your first data set.Cognite's Power BI Connector certified by MicrosoftWe're excited to announce that Microsoft has certified the Cognite Power BI Connector and that the connector is now publicly available. The Cognite Power BI Connector enables data consumers to easily read, analyze, and present data from Cognite Data Fusion (CDF) in compelling visualizations in both Power BI Desktop and the Power BI service.You can find the connector in the Other category of the Get Data dialog in Power BI. Learn more in our in-depth article.New upcoming transformation capabilitiesWe're continuing our work to improve the asset hierarchy functionality in SQL Transformations. You will soon be able to ingest multiple asset hierarchies at the same time and also ingest asset sub-trees to any level of the hierarchy. The asset hierarchies and sub-trees will merge perfectly with your existing or newly built asset hierarchy.To give you a more precise and manageable overview of your jobs, we are also updating the UI with additional details about each job: status, time of schedule, last run, duration, and the option to resume or stop a schedule.

Related products:

Cognite Data Fusion - Introducing data sets

Many of you love the current data sets feature in the Cognite Console that lets you manually document metadata for your data sources. Now, we are taking data sets to the next level and making data sets a full-stack integrated solution.Data sets let you document and track data lineage, ensure data integrity, and allow 3rd parties to write their insights securely back to your Cognite Data Fusion (CDF) project.Data sets group and track data by its source. For example, a data set can contain all work orders originating from SAP, or the output data from a 3rd party partner's machine learning model. Typically, organizations have one data set for each of its data ingestion pipelines in CDF.To get started with data sets:Check out our in-depth article to learn more. Navigate to the fusion.cognite.com , select Data sets, and follow the steps in our guide to create your first data set.Trace data lineageIT managers need to know which data is currently available in their CDF project. Data scientists need to know if they can rely on the input data for the use cases they're solving, and who to contact if they need more information. IT support staff need to know how the data is integrated to help troubleshoot any issues.Ensure data integrityWhen data engineers and IT managers have designed, implemented, and approved the data ingestion pipelines, they need to protect the pipelines from accidental changes to keep the data valid and accurate.Let 3rd parties write data securely back to CDFWhen you want 3rd parties to write their insights back to your CDF project, you need to provide a safe container to hold their data and, at the same time, safeguard data from your other data pipelines.ResourcesData sets are available through:CDF API v1 Postman collection Official SDKs: Python SDK 1.5.0 (opens new window), JavaScript SDK 2.24.1

Related products:Access & Group Management