Kafka

Good day. I have configured Kafka to run on docker swarm, when I try to use Python to send messages, I am being presented with the error messages such as the ones below in rapid succession, non-stop. What changes should I make so that I am able to send messages to the broker? ERROR:kafka.conn:Connect attempt to <BrokerConnection node_id=1 host=localhost:9092 <connecting> [IPv6 ('::1', 9092, 0, 0)]> returned error 111. Disconnecting. INFO:kafka.conn:<BrokerConnection node_id=1 host=localhost:9092 <connecting> [IPv6 ('::1', 9092, 0, 0)]>: Closing connection. KafkaConnectionError: 111 ECONNREFUSED WARNING:kafka.client:Node 1 connection failed -- refreshing metadata INFO:kafka.conn:<BrokerConnection node_id=1 host=localhost:9092 <connecting> [IPv4 ('127.0.0.1', 9092)]>: connecting to localhost:9092 [('127.0.0.1', 9092) IPv4] ERROR:kafka.conn:Connect attempt to <BrokerConnection node_id=1 host=loc...

Sorry for the broken link, retrying-  https://issues.apache.org/jira/browse/KAFKA-19552   On Saturday, July 26, 2025, 11:02 PM, Mcs Vemuri < mcsvemuri@yahoo.com > wrote: Hello, Can anyone please check this bug - ASF JIRA  Unclean leader election failing to happen- while being desired-  leaves cluster broken when brokers leave suddenly and indefinitely   | | | ASF JIRA | | | Sent from Yahoo Mail for iPhone

Hello, Can anyone please check this bug - ASF JIRA  Unclean leader election failing to happen- while being desired-  leaves cluster broken when brokers leave suddenly and indefinitely   | | | ASF JIRA | | | Sent from Yahoo Mail for iPhone

Hello Kafka users, developers and client-developers, This is the first candidate for release of Apache Kafka 4.0.1. Since this is a patch version it contains the bug fixes outlined in the release notes below! Release notes for the 4.0.1 release: https://dist.apache.org/repos/dist/dev/kafka/4.0.1-rc0/RELEASE_NOTES.html *** Please download, test and vote by Wednesday July 30. Kafka's KEYS file containing PGP keys we use to sign the release: https://kafka.apache.org/KEYS * Release artifacts to be voted upon (source and binary): https://dist.apache.org/repos/dist/dev/kafka/4.0.1-rc0/ * Docker release artifacts to be voted upon: apache/kafka:4.0.1-rc0 apache/kafka-native:4.0.1-rc0 * Maven artifacts to be voted upon: https://repository.apache.org/content/groups/staging/org/apache/kafka/ * Javadoc: https://dist.apache.org/repos/dist/dev/kafka/4.0.1-rc0/javadoc/ * Tag to be voted upon (off 4.0 branch) is the 4.0.1 tag: https://github.com/apache/k...

Re, Thank you very much for your help! I wandered around for several days. It worked by adding to a clickhouse connector creation http request: * "consumer.override.ssl.truststore.location": "/opt/kafka/kafka.ca.pem", "consumer.override.ssl.truststore.type": "PEM", "consumer.override.ssl.keystore.type": "PEM", "consumer.override.ssl.keystore.location": "/opt/kafka/kafka.client.p8.pem", "consumer.override.ssl.client.auth": "required" * /Domantas On Wed, Jul 23, 2025 at 4:59 PM Chris Egerton < fearthecellos@gmail.com > wrote: > Hi Domantas, > > For sink connectors, you'll need to add all SSL-related properties either > to your Connect worker file prefixed with "consumer.", or to your > individual connector files prefixed with "consumer.override.". > > If you're using the DLQ fe...

Hello Sébastien, thanks for reaching out. The fix was not back ported to 3.x branches, because it is very unlikely that there will be another 3.x bug fix release. Kafka community usually only does bug-fix releases for the last minor release, and there was already 3.9.1. With 4.1.0 being in the process or getting release, we would only do another 3.9.2 bug-fix release if there is some highly critical issue, and user cannot upgrade to a newer 4.x version. A 3.8.2 or older version bug-fix release is even more unlikely. Thus, my recommendation would be, to wait for 4.0.1 ( https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+4.0.1 ) or 4.1.0 ( https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+4.1.0 ) and upgrade your KS app to either one version to get the fix. -Matthias On 7/21/25 10:22 AM, Sébastien wrote: > Hi everyone, > > I'm upgrading my old Kafka Stream application currently in 2.6. to 3.8.1 >...

Hi Domantas, For sink connectors, you'll need to add all SSL-related properties either to your Connect worker file prefixed with "consumer.", or to your individual connector files prefixed with "consumer.override.". If you're using the DLQ feature, you'll also need to do the same but with "admin." (worker file) or "admin.override." (connector files). And, for source connectors, do the same but with "producer." (worker file) / "producer.override." (connector files). Cheers, Chris On Wed, Jul 23, 2025, 08:31 Domantas Spečiūnas <domantas.speciunas@aardvark.technology.invalid> wrote: > HI, > > I have issue connecting to to kafka with SSL, tried a lot of options and > stuck, maybe someone can suggest what is wrong here, on clickhouse side > everything is fine: > > [root@server.tld01 config]# cat connect-distributed.properties | grep -v > ^# | grep -v '^...