Skip to main content
Planned for development

CDF to handle String Timeseries

Related products:Charts
  • June 22, 2023
  • 17 replies
  • 257 views

Hello,

We’re currently having some issues with pulling our PI data from Cognite since we have several PI tags that are string timseries vs numeric (as in rather than having 0 or 1, the timeseries shows open or closed). It appears that Cognite cannot handle string timeseries because they cannot be aggregated, however some of the logic that’s built in to our devices can only be pulled in this manner. We’d at least need a way for Cognite to convert the data pulled as strings as numeric and maybe auto assigning numeric values to each string event? A bonus would be to have an associated conversion of those numeric values to the associated string from the pull

Example:

Cognite pulls timseries EXAMPLE.TIME.VALVE.A.STATUS that contains “Open” and “Closed” and auto assigns 0 to “Open” and 1 to “Closed”

There’s then an associated ‘conversion’ that states for timeseries EXAMPLE.TIME.VALVE.A.STATUS:

0 = “Open”

1 = “Closed”

 

then Cognite pulls another timeseries EXAMPLE.TIME.VALVE.B.STATUS and happens to assign 0 to “Closed” and 1 to “Open” for whatever reason

There’s then an associated ‘conversion’ that states for timeseries EXAMPLE.TIME.VALVE.B.STATUS:

0 = “Closed”

1 = “Open”

 

17 replies

ibrahim.alsyed
Seasoned
Forum|alt.badge.img

I totally agree. I have been mentioning this to Cognite for a while.


Anita Hæhre
Seasoned Practitioner
Forum|alt.badge.img+1
  • Head of Community
  • June 27, 2023

Hi @rmaidla and @ibrahim.alsyed thank you for your request, we appreciate it. Our expert in this particular field, @Glen Sykes, is currently on vacation and will not be available until the end of July. However, rest assured that once he returns, he will promptly respond to your query. If you have any urgent concerns please let us know, and we will do our best to provide alternative support in the meantime. Thank you, 


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • August 31, 2023

Hi Richard and Ibrahim,

I’m the product manager for Time Series and other high volume type services in CDF.

I’m keen to understand the data pattern and use case here, as in addition to enhancing Time Series, we are also in the planning and design phase for a new service that will handle high volume, system generated events/logs/alarms, which might be a potential better fit for your use case.

Can you provide more details here, or shall we have a call to discuss?
Kind Regards, Glen

 


ibrahim.alsyed
Seasoned
Forum|alt.badge.img

Glen - we need the ability for the time series to not just be numerical. We would like to see a time series that shows trends with something like High, Medium Low and we can trend it instead of coding it to ,1,2,3 respectively. 

 

 


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • September 1, 2023

Are these values used in isolation, or in conjunction with ‘adjacent’ time series, or in other words would this requirement be better stored in a ‘tabular’ format than a single time series?

Are the values used to trigger alerts in real or close to real time, or is the pattern more about retrospective analysis of trends?

Is the data likely to need (frequent) updates, or can we take an immutable approach to storing the values?

 


ibrahim.alsyed
Seasoned
Forum|alt.badge.img

people would like to trend so a time series is required. 

For example, an operator records the status in HI or LO as there is no numerical value. The would like to trend it on a chart over daily. The readings are taken 2 times a day etc

 

Ibrahim 


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • September 1, 2023

OK I think I understand.  And the chart would only feature a single time series, or multiple?  And what’s the time resolution / sample rate (assuming your batching when you take a reading, or is it two data points per day?)

 


ibrahim.alsyed
Seasoned
Forum|alt.badge.img

single time series and data should update on the frequency it receives the update. 


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • September 1, 2023

Thanks, now I think I have everything!


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • October 12, 2023

Hello again @rmaidla and @ibrahim.alsyed 

Other than “Open” and “Closed”, what other string statuses are in use that need to be represented in a Chart please?


  • Author
  • Committed
  • October 12, 2023

It could be anything. For our platforms offshore, a lot of times we use this type of data to show which wells are flowing through which separator, or conversely which flowline is being used for a given well based off of the valve position. 

The requirement is to be able to handle a source text timeseries as is the capability in OSI PI. 


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • October 12, 2023

OK, so from the Charts UI perspective, you would like the ability for a given Time Series (or group of Time Series that share the same String values) to define positions on the Y axis that correspond to strings that occur in those Time Series, and then plot the occurrence of those strings as they appear in the chart.

So for example, you’d select the time series you’d want to plot, the strings in the Time Series would appear on the Y axis, you would have the ability to adjust the position of the strings to suit your needs, and then the occurrence of those strings would be plotted over time.  

Do I have it right?


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • November 30, 2023

Following up on this request.  Representation of Machine States in Time Series is now in our program backlog for 2024.  By our current estimation we will have capacity to deliver this in Q3/Q4 timeframe.  Timescales are subject to adjustment of course.



 


dalvaniamp
Seasoned
Forum|alt.badge.img+5
  • Seasoned
  • August 28, 2024

Hello everyone. Any updates on this topic?


Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • August 29, 2024

Hi @dalvaniamp 

We expect to commence development of the feature imminently, and our estimates are that we should have the feature available in Beta toward the end of Q4.  We are juggling this work alongside another critical (non-functional / architectural) requirement so there is some risk of this timeline slipping, but as of right now we are looking ok.

 


msibs90
Committed
Forum|alt.badge.img+1
  • Committed
  • April 10, 2025

Hello, is there any update on this ?


Forum|alt.badge.img

Hi,

Due to short-term shifts in priorities, the Machine State Time Series beta was pushed back to Q3 (as of right now), which also affects out ability to GA the functionality. 

As of right now, it looks like we may be able to include the GA release of Machine State Time Series in the Q4, 2025 release.