Skip to main content
Solved

Which features in Charts look at aggregated data instead of raw data?

  • January 16, 2025
  • 3 replies
  • 30 views

Forum|alt.badge.img+6

I noticed when you're looking at a large time frame, the threshold feature on Charts only looks at the aggregated values, not the raw or even min/max values. Is this the same with the data profiler and monitoring jobs?

Best answer by Neringa Altanaite

Hi Emily, 

That is a very good question! 

If the time series has more than 100.000 data points in the time frame you are looking at, then calculation, thresholds, statistics will be performed on aggregates.

The same behaviour is valid for scheduled calculation if the scheduled window contains more than 100.000 data points. This is rarely the case and it could be avoided by choosing to run scheduled calculations more frequently. 

Data profiling will not show results if time series have more than 100.000 data points in the selected time window. However, if you select a calculation, that was already performed on aggregates due to the 100.000 data points, data profiling will show you result based on the aggregated calculation. 

However, this is not the case for monitoring jobs as they run on a small 5 minutes window and use a different algorithm. 

Let me know if you have more questions! 

Have a nice day! 

Neringa

View original
Did this topic help you find an answer to your question?

3 replies

Hi Emily, 

That is a very good question! 

If the time series has more than 100.000 data points in the time frame you are looking at, then calculation, thresholds, statistics will be performed on aggregates.

The same behaviour is valid for scheduled calculation if the scheduled window contains more than 100.000 data points. This is rarely the case and it could be avoided by choosing to run scheduled calculations more frequently. 

Data profiling will not show results if time series have more than 100.000 data points in the selected time window. However, if you select a calculation, that was already performed on aggregates due to the 100.000 data points, data profiling will show you result based on the aggregated calculation. 

However, this is not the case for monitoring jobs as they run on a small 5 minutes window and use a different algorithm. 

Let me know if you have more questions! 

Have a nice day! 

Neringa


Forum|alt.badge.img+6
  • Author
  • Committed
  • 16 replies
  • January 21, 2025

Thank you for the detailed reply, Neringa! 

So monitoring jobs look at raw data?


Forum|alt.badge.img+6
  • Author
  • Committed
  • 16 replies
  • January 21, 2025

Also, do thresholds look at max/min during the aggregate period, or just the aggregate average?


Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings