Skip to main content
Solved

Limits on Hosted Kafka Extractor Jobs & Wildcard Support for Topics

  • February 3, 2025
  • 1 reply
  • 27 views

Forum|alt.badge.img

I am using the Hosted Kafka Extractor and need to subscribe to multiple topics with specific filters. To do this, I plan to create multiple jobs under one connection. I have a few questions:

  1. What is the maximum number of jobs that can be created in a single connection?
  2. How many hosted extractors can be created in a Cognite project?
  3. Does the Hosted Kafka Extractor support wildcard characters for topic subscriptions?

I checked the Hosted Extractors and Kafka Extractor documentation, but I couldn't find clear limits on job or extractor counts. Also, the Kafka Extractor job seems to subscribe to a single topic at a time, so I'm unsure if wildcards are supported.

Could someone clarify these limits and wildcard support?

Best answer by Einar Omang

  1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
  1. See 1
  2. Kafka does not support wildcard topics, so we don’t, at the moment.
View original
Did this topic help you find an answer to your question?

1 reply

  • Practitioner
  • 75 replies
  • Answer
  • February 3, 2025
  1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
  1. See 1
  2. Kafka does not support wildcard topics, so we don’t, at the moment.

Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings