Skip to main content
Committed ⭐️⭐️
Siddharth Anand
Committed ⭐️⭐️
February 3, 2025
Solved

Limits on Hosted Kafka Extractor Jobs & Wildcard Support for Topics

I am using the Hosted Kafka Extractor and need to subscribe to multiple topics with specific filters. To do this, I plan to create multiple jobs under one connection. I have a few questions:

  1. What is the maximum number of jobs that can be created in a single connection?
  2. How many hosted extractors can be created in a Cognite project?
  3. Does the Hosted Kafka Extractor support wildcard characters for topic subscriptions?

I checked the Hosted Extractors and Kafka Extractor documentation, but I couldn't find clear limits on job or extractor counts. Also, the Kafka Extractor job seems to subscribe to a single topic at a time, so I'm unsure if wildcards are supported.

Could someone clarify these limits and wildcard support?

    Einar OmangAnswer
    Practitioner ⭐️⭐️⭐️
    February 3, 2025
    1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
    1. See 1
    2. Kafka does not support wildcard topics, so we don’t, at the moment.
    View in thread

    1 reply

    Practitioner ⭐️⭐️⭐️
    Einar OmangAnswer
    Practitioner ⭐️⭐️⭐️
    February 3, 2025
    1. The current maximum number of jobs per project is 100. There is no specific limit per connection.
    1. See 1
    2. Kafka does not support wildcard topics, so we don’t, at the moment.
      Terms & ConditionsAccessibility statement