Skip to main content
Implemented

Include a quality marker from PI on datapoints

  • August 9, 2023
  • 7 replies
  • 126 views

Liv Hagen
Practitioner ⭐️⭐️⭐️

PI drops some datapoints due to poor quality. Ideally this would be written to CDF with some sort of indication on the quality of the data. 

7 replies

Forum|alt.badge.img

Hi Liv, and once again thank you for forwarding this product idea from Celanese.

I have (for now) asked @Glen Sykes to process the idea for consideration. As a heads-up, since the essence of this request spans different product components, it may be somebody other than Glen who responds / follows up.


Forum|alt.badge.img+2
  • Seasoned ⭐️⭐️⭐️
  • August 10, 2023

If there is a data gap in a time window, the end user should be able to configure whether to interpolate the data or have the data as is, coming from the timeseries data source. This is of importance during root cause analysis, in scenarios such as a faulty transmitter leading to subsequent/major events.


  • Practitioner ⭐️⭐️⭐️
  • August 14, 2023

FYI: This is an issue raised by AkerBP as well, leading to a lot of confusion on how to trust data. Knut Vidvey, Jørgen Tennøe og Terje Løken informed about this issue as part of how CDF can approach data quality. 


Glen Sykes
Expert ⭐️⭐️⭐️⭐️
  • Expert ⭐️⭐️⭐️⭐️
  • August 14, 2023

Thanks for the tag @Thomas Sjølshagen .  I am actively investigating the solution options to satisfy this requirement, and it carries a high priority on my product backlog.

@rsiddha and @Benjamin Medbøen, I’ve reached out to Knut already to understand the workflow in more detail, about how the quality scores would be used and the further actions triggered, but I would value first hand feedback from you if you would be happy to spend a little time with me on this?


  • Practitioner ⭐️⭐️⭐️
  • August 14, 2023

For sure, schedule a meeting when possible. I can also share with you the Data Qulity assessment done for AkerBP which highlights this issue 


Forum|alt.badge.img+2
  • Seasoned ⭐️⭐️⭐️
  • August 14, 2023

Sure, Please schedule this and include  @ibrahim.alsyed and @Robert from Celanese as well, along with me. 


Glen Sykes
Expert ⭐️⭐️⭐️⭐️
  • Expert ⭐️⭐️⭐️⭐️
  • February 27, 2024

Hello All,

I am pleased to confirm that this feature is now available in Beta, please refer to our updated introduction page on the developer portal, and our API documentation for further details.  The feature will be formally announced in our release communications on the 5th March.  We hope to bring this feature to full General Availability level of maturity in our subsequent release, depending on good and timely customer feedback.

In order to ingest Time Series data points with status codes, you will need to update your OPC-UA or PI extractor to the latest beta version. 

The API updates should not affect any existing applications or integrations and it is possible to have a mix of old data points (where bad and uncertain quality data is missing) and new data points with status codes.  The API will continue to behave the same by default.

An update to Cognite Charts to support status codes in how Charts are plotted is in the works, and a separate update will come from the Charts team nearer the time when that will be ready.