Skip to main content

RE: Reg : Slowness in Kafka

> There are serious latency issues when mixing different client and server version

Could you be more specific ? Link to any issue ?

Thanks by advance !

Christophe
________________________________
De : James Olsen <james@inaseq.com>
Envoyé : vendredi 27 mars 2020 01:48
À : users@kafka.apache.org <users@kafka.apache.org>
Objet : Re: Reg : Slowness in Kafka

Also check your Kafka Client and Server versions. There are serious latency issues when mixing different client and server versions IF your consumers handle multiple partitions.

> On 27/03/2020, at 12:59, Chris Larsen <clarsen@confluent.io> wrote:
>
> Hi Vidhya,
>
> How many tasks are you running against the topic? How many partitions are
> on the topic? Can you post the connector config anonymized?
>
> Best,
> Chris
>
> On Thu, Mar 26, 2020 at 17:58 Vidhya Sakar <sakar.black@gmail.com> wrote:
>
>> Hi Team,
>>
>> The Kafka consumer is reading only 8 records per second.We have implemented
>> apache Kafka and confluent connect S3. The confluent connect S3 collects
>> the records and pushes it to S3 bucket.
>> In this process, we are seeing some slowness like on an average only 8
>> records is being processed for a second. am planning to have a higher
>> throughout results, so that where there is a higher data load, it should
>> process more number of records.
>>
>> Thanks in advance.
>>
> --
>
> *Chris Larsen*
>
> Systems Engineer | Confluent
>
> 847.274.3735
>
> Follow us: Twitter <https://twitter.com/ConfluentInc> | blog
> <https://www.confluent.io/blog/>


Post-scriptum La Poste

Ce message est confidentiel. Sous reserve de tout accord conclu par
ecrit entre vous et La Poste, son contenu ne represente en aucun cas un engagement de la part de La Poste. Toute publication, utilisation ou diffusion, meme partielle, doit etre autorisee prealablement. Si vous n'etes pas destinataire de ce message, merci d'en avertir immediatement
l'expediteur.

Comments