Re: Reg : Slowness in Kafka

Also check your Kafka Client and Server versions. There are serious latency issues when mixing different client and server versions IF your consumers handle multiple partitions.

> On 27/03/2020, at 12:59, Chris Larsen <clarsen@confluent.io> wrote:
>
> Hi Vidhya,
>
> How many tasks are you running against the topic? How many partitions are
> on the topic? Can you post the connector config anonymized?
>
> Best,
> Chris
>
> On Thu, Mar 26, 2020 at 17:58 Vidhya Sakar <sakar.black@gmail.com> wrote:
>
>> Hi Team,
>>
>> The Kafka consumer is reading only 8 records per second.We have implemented
>> apache Kafka and confluent connect S3. The confluent connect S3 collects
>> the records and pushes it to S3 bucket.
>> In this process, we are seeing some slowness like on an average only 8
>> records is being processed for a second. am planning to have a higher
>> throughout results, so that where there is a higher data load, it should
>> process more number of records.
>>
>> Thanks in advance.
>>
> --
>
> *Chris Larsen*
>
> Systems Engineer | Confluent
>
> 847.274.3735
>
> Follow us: Twitter <https://twitter.com/ConfluentInc> | blog
> <https://www.confluent.io/blog/>