Hello Cognite Community,We are evaluating the throughput limits of the Cognite Hosted MQTT Extractor.Our use case involves subscribing to MQTT topics and storing the received messages in CDF RAW. Each MQTT message has a payload smaller than 1 KB.We would like to clarify the following: Are there any hard limits on MQTT message throughput (messages/second)? Per MQTT client connection Per subscription (topic filter) Per Hosted Extractor job If there are no fixed limits, what is the recommended maximum sustained throughput (messages/second)? What happens if the incoming message rate exceeds the Hosted MQTT Extractor's processing capacity? Are messages buffered? Are failed messages retried? Is there a risk of message loss? Do the CDF RAW API write quotas also apply to Hosted MQTT Extractors, or are there separate internal limits? We would appreciate any official documentation, benchmarks, or practical experience regarding these limitations.Thank you!

Active ⭐️⭐️⭐️

Question

Hosted MQTT Extractor – MQTT Message Throughput Limits and Quotas

Hello Cognite Community,

We are evaluating the throughput limits of the Cognite Hosted MQTT Extractor.

Our use case involves subscribing to MQTT topics and storing the received messages in CDF RAW. Each MQTT message has a payload smaller than 1 KB.

We would like to clarify the following:

Are there any hard limits on MQTT message throughput (messages/second)?
- Per MQTT client connection
- Per subscription (topic filter)
- Per Hosted Extractor job
If there are no fixed limits, what is the recommended maximum sustained throughput (messages/second)?
What happens if the incoming message rate exceeds the Hosted MQTT Extractor's processing capacity?
- Are messages buffered?
- Are failed messages retried?
- Is there a risk of message loss?
Do the CDF RAW API write quotas also apply to Hosted MQTT Extractors, or are there separate internal limits?

We would appreciate any official documentation, benchmarks, or practical experience regarding these limitations.

Thank you!