Skip to main content

Regarding Kafka connect task to partition relationship for both source and sink connectors

Hi everyone,


From my understanding, if a topic has  n partitions, we can create up to n tasks for both the source and sink connectors to achieve the maximum parallelism. Adding more tasks would not be beneficial, as they would remain idle and be limited to the number of partitions of the topic


Could you please confirm if this understanding is correct?


If this understanding is incorrect could you please explain the relationship if any?


Thank you!

Comments