Kafka

Hi Deepak, So, if you change the value in max.block.ms to default 1 minute, does the timeout exception still exist? I think the timeoutException is complaining the 250ms is not a good configuration for your environment. Thank you. Luke On Tue, Jun 7, 2022 at 11:23 AM Deepak Jain < deepak.jain@cumulus-systems.com > wrote: > Hi, > > Thanks for the quick reply. > > We are already using the config max.block.ms (alongwith with other > recommended config like request.timeout.ms and others). Although the > value we are using is very less at 250 ms but since we have 5 different > KafkaProducer running in each individual thread out of which 4 are working > without any issue and only 1 is throwing the TimeOutException, so this does > not seems to be the issue, > > Please else us know if anybody had came across this type of behaviour by > Kafka. If yes, please help in finding out the root cause and resolving it. > ...

Dear Users, Few questions regarding authentication 1- in case of implementation of SASL/SCRAM without SSL with below param listeners=SASL_PLAINTEXT:// apache-kafka.abc.com:9090 security.inter.broker.protocol=SASL_PLAINTEXT sasl.mechanism.inter.broker.protocol=SCRAM-SHA-256 sasl.enabled.mechanisms=SCRAM-SHA-256 2- zookeeper is still not secured 3- New broker gets added without any jaas file in existing broker config. Am i missing something? New borker should fail with failed Authentication message ? 4- client is working properly .Client does not work unless client property is passed Regards, Rohit Garg

Hi, Thanks for the quick reply. We are already using the config max.block.ms (alongwith with other recommended config like request.timeout.ms and others). Although the value we are using is very less at 250 ms but since we have 5 different KafkaProducer running in each individual thread out of which 4 are working without any issue and only 1 is throwing the TimeOutException, so this does not seems to be the issue, Please else us know if anybody had came across this type of behaviour by Kafka. If yes, please help in finding out the root cause and resolving it. Regards, Deepak -----Original Message----- From: 张晓寅 < zhxy0605@gmail.com > Sent: 06 June 2022 19:10 To: users@kafka.apache.org Cc: Luke Chen < showuon@gmail.com > Subject: Re: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env Caution: From Cumulus Systems – IT Department, this email originated from outside of the organization. Pl...

Is it possible to run https://github.com/apache/kafka/tree/2.5.0/connect/mirror with Kafka 2.6? It does not seem like the best idea, but we are in a situation where that may need to happen, if possible. Thanks! This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.

maybe you can add producer " max.block.ms " config,but you should test your broker look up some logs about leader change ,producer performance,like traffic ,produce "buffer" and "batch.size" On Mon, Jun 6, 2022 at 6:53 PM Deepak Jain < deepak.jain@cumulus-systems.com > wrote: > Hello All, > > Please help me out in this regard as the Customer has reported this on > their production environment and waiting for our reply ASAP. > > Regards, > Deepak > > From: Deepak Jain > Sent: 02 June 2022 20:53 > To: ' users@kafka.apache.org ' < users@kafka.apache.org > > Cc: 'Luke Chen' < showuon@gmail.com >; Alap Patwardhan < > alap@cumulus-systems.com >; Bhushan Patil < > bhushan.patil@cumulus-systems.com > > Subject: Random continuous TimeoutException with Topic not present on one > KafkaProducer out of many in multithreaded env > > Hello Everyo...

Hello All, Please help me out in this regard as the Customer has reported this on their production environment and waiting for our reply ASAP. Regards, Deepak From: Deepak Jain Sent: 02 June 2022 20:53 To: ' users@kafka.apache.org ' < users@kafka.apache.org > Cc: 'Luke Chen' < showuon@gmail.com >; Alap Patwardhan < alap@cumulus-systems.com >; Bhushan Patil < bhushan.patil@cumulus-systems.com > Subject: Random continuous TimeoutException with Topic not present on one KafkaProducer out of many in multithreaded env Hello Everyone, We are using Kafka 2.8.1 Broker/Client system in our prod env. Getting following exception randomly after 1 hour or so for one Realtime transfer from Kafka Producer to broker out of 5. (Rest 4 are working fine.) java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Topic realtimeImport_1 not present in metadata after 250 ms. at org.apache.kafka....

Hi, Did you tried to use? org.apache.zookeeper.server.auth.DigestLoginModule instead of org.apache.kafka.common.security.plain.PlainLoginModule Regards, François On 06/06/2022 11:27, Ivanov, Evgeny wrote: > org.apache.kafka.common.security.plain.PlainLoginModule required -- -- François