Skip to main content
Answer

Limits on Hosted Kafka Extractor Jobs & Wildcard Support for Topics

  • February 3, 2025
  • 1 reply
  • 42 views
S
Active
Forum|alt.badge.img

I am using the Hosted Kafka Extractor and need to subscribe to multiple topics with specific filters. To do this, I plan to create multiple jobs under one connection. I have a few questions:

  1. What is the maximum number of jobs that can be created in a single connection?
  2. How many hosted extractors can be created in a Cognite project?
  3. Does the Hosted Kafka Extractor support wildcard characters for topic subscriptions?

I checked the Hosted Extractors and Kafka Extractor documentation, but I couldn't find clear limits on job or extractor counts. Also, the Kafka Extractor job seems to subscribe to a single topic at a time, so I'm unsure if wildcards are supported.

Could someone clarify these limits and wildcard support?

Best answer by Einar Omang

  1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
  1. See 1
  2. Kafka does not support wildcard topics, so we don’t, at the moment.
Mithila Jayalath

1 reply

E
Practitioner
  • Einar Omang
  • Practitioner
  • Answer
  • February 3, 2025
  1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
  1. See 1
  2. Kafka does not support wildcard topics, so we don’t, at the moment.
Mithila Jayalath
S
Terms & ConditionsCookie SettingsAccessibility statement