Skip to main content
Practitioner ⭐️
Jul 31, 2024 9:12 AM UTC
Solved

Is there change in Timeseries Subscription Limit

As per documentation, it is mentioned that 10,000 timeseries is the limit in each subscription. I see issue with count while adding timeseries using SDK.

I have created timeseries subscription through SDK, it took more than 10000 timeseries. Is there any change in limit under subscription ? 

 

matiasholte
Backend developer
Aug 13, 2024 8:15 AM UTC

We have now changed the behavior, so that you cannot add more time series to a subscription, unless the resulting subscription would contain 10k time series or less.

The existing time series with more than 10k time series will still function, and you can remove time series from them, but not add.

6 replies

Glen Sykes
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Jul 31, 2024 11:18 AM UTC

Hi Rimmi,

Many thanks for bringing this to our attention.  This isn’t expected behaviour and the limit (for the time being at least) remains at 10,000.  The team is investigating and I’ll come back to you if we need any more information.

Just FYI, any changes to limits such as this will (as a minimum) be communicated in our changelog, but I would also notify the user community in a post here too.

Kind Regards, Glen

Glen | Cognite Product Management
Glen Sykes
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Jul 31, 2024 11:48 AM UTC

@Rimmi Anand are you using a filter subscription in this example?

Glen | Cognite Product Management
Practitioner ⭐️
Jul 31, 2024 5:36 PM UTC

@Glen Sykes , I am adding timeseries using create and update SDK without any filter. Sharing code for analysis:

CREATE - sub = DataPointSubscriptionWrite(

                    external_id=sub_id,

                    name="Aggregation Timeseries Subscription",

                    partition_count=1,

                    time_series_ids = ts_ids)

                 client.time_series.subscriptions.create(sub)

UPDATE - update = DataPointSubscriptionUpdate(sub_id).time_series_ids.add(ts_ids)

                  client.time_series.subscriptions.update(update)

I have added filter on dataset for timeseries subscription. Timeseries count there remain 10,000, even if I have more than 10,000 timeseries in that dataset. Sharing snippet.

 

Glen Sykes
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Aug 1, 2024 8:34 AM UTC

Hi again @Rimmi Anand 

The team have confirm this is unexpected behaviour/ a bug which we will have to fix.

Kind Regards, Glen

Glen | Cognite Product Management
matiasholte
Practitioner ⭐️⭐️⭐️
Backend developer
Aug 13, 2024 8:15 AM UTC

We have now changed the behavior, so that you cannot add more time series to a subscription, unless the resulting subscription would contain 10k time series or less.

The existing time series with more than 10k time series will still function, and you can remove time series from them, but not add.

Dilini Fernando
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Aug 28, 2024 4:54 PM UTC

Hi @Rimmi Anand,

We are following up to see whether you're satisfied with the responses you've received?