Re: Designing a low latency consumer

Here's a great resource. Includes links to even more at the end.
https://www.confluent.io/blog/configure-kafka-to-minimize-latency/

---------- Forwarded message ----------
> From: Vasant Surya Teja <vasant.teja@gmail.com>
> To: users@kafka.apache.org
> Cc:
> Bcc:
> Date: Wed, 20 Jul 2022 18:13:02 -0500
> Subject: Designing a low latency consumer
> Hi Team,
>
> I need a small advise from you on how to design a low latency consumer. I
> am aiming to reduce the amount of time it takes to transfer data from Kafka
> to my sink. During this research I came across two properties. They are:
> 1. fetch.min.bytes
> 2. fetch.max.wait.ms
> I am planning to reduce the default values on both these properties to half
> and see if I can increase the efficiency of my consumer. Is this a good
> idea to tune the default values or should I leave them as it is? Can you
> please let me know the repercussions related to this?
>
> Thanks
> Teja
>

--

Patrick Taylor

Sr. Principal Software Engineer
ptaylor@snaplogic.com
Mobile: 303-594-8979
Boulder, Colorado (US Mountain Time)


<http://www.snaplogic.com/about-us/jobs>



*SnapLogic Inc | 1825 South Grant Street | San Mateo CA | USA *


This message is confidential. It may also be privileged or otherwise
protected by work product immunity or other legal rules. If you have
received it by mistake, please let us know by e-mail reply and delete it
from your system; you may not copy this message or disclose its contents to
anyone. The integrity and security of this message cannot be guaranteed on
the Internet.