Kafka

Hi fellow kafka users, Recently we tried and are stuck in the middle of a migration from kafka 3.2 to 3.9. We upgrade one broker (setting inter.broker.protocol.version=3.2-IV0 to ensure compat, not setting log.message.format.version cause it's supposed to be the same aka 3.0-IV1). One important things is : - data were on a ephemeral storage, so broker restarted empty - we do not drain the cluster before (aka not moving off partition leadership) It should have done automatically but.. After that we encounter lot of but not everywhere producing, consuming and transactions errors (I discovered transactions at this occasion) from lot of our application. It take time to stabilize. My guess is everything came back to normal when I manually reassigned partition leadership from the migrated/rebooted broker. (particularly __consummer_offsests and __transactions_state). I don't understand why we ended in this state. If you have ideas :) So after dealing with data back filling (but that...

Hello, Has anyone successfully made replication throttling work? I am doing the following on Apache Kafka 3.5 ./kafka_2.13-3.7.1/bin/kafka-configs.sh \ --bootstrap-server $BROKERS \ --entity-type brokers \ --entity-default \ --alter \ --add-config leader.replication.throttled.rate=50000000 \ --command-config client.properties ./kafka_2.13-3.7.1/bin/kafka-configs.sh \ --bootstrap-server $BROKERS \ --entity-type brokers \ --entity-default \ --alter \ --add-config follower.replication.throttled.rate=50000000 \ --command-config client.properties TOPICS=$(./kafka_2.13-3.7.1/bin/kafka-topics.sh --bootstrap-server $BROKERS --list --command-config client.properties) for TOPIC in $TOPICS; do echo "Applying throttle to topic: $TOPIC" ./kafka_2.13-3.7.1/bin/kafka-configs.sh \ --bootstrap-server $BROKERS \ --entity-type topics \ --entity-name $TOPIC \ --alter \ --add-config leader.replication.throttled.rep...

There is a compatibility matrix for Zk versions available until v3.8 here - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=240882784#KIP902:UpgradeZookeeperto3.8.2-Compatibility,Deprecation,andMigrationPlan -- Divij Vaidya On Tue, Dec 10, 2024 at 3:27 PM Chia-Ping Tsai < chia7712@gmail.com > wrote: > hi > > > I have to upgrade Apache Kafka from 3.3 to the latest stable version. > > The latest version that supports ZooKeeper is *3.9.0*. > > By the way, there is a pull request #18091 > < https://github.com/apache/kafka/pull/18091 > aiming to add a comprehensive > compatibility matrix. > > You can find more information in that PR. > Best, > Chia-Ping > > Kiran Satpute < kiransatpute52@gmail.com > 於 2024年12月10日 週二 下午6:26寫道： > > > Hi Team, > > > > Can I get Apache Kafka and Zookeeper Compatibility matrix. > > I have to upgrade Apache Kafka from...

hi > I have to upgrade Apache Kafka from 3.3 to the latest stable version. The latest version that supports ZooKeeper is *3.9.0*. By the way, there is a pull request #18091 < https://github.com/apache/kafka/pull/18091 > aiming to add a comprehensive compatibility matrix. You can find more information in that PR. Best, Chia-Ping Kiran Satpute < kiransatpute52@gmail.com > 於 2024年12月10日 週二 下午6:26寫道： > Hi Team, > > Can I get Apache Kafka and Zookeeper Compatibility matrix. > I have to upgrade Apache Kafka from 3.3 to the latest stable version. > Please suggest the latest stable version of both apache kafka and > zookeeper. > > -- > Thanks & Regard > Kiran Satpute > (9921424521) >

Hi Team, Can I get Apache Kafka and Zookeeper Compatibility matrix. I have to upgrade Apache Kafka from 3.3 to the latest stable version. Please suggest the latest stable version of both apache kafka and zookeeper. -- Thanks & Regard Kiran Satpute (9921424521)

Hi Matthias, Thanks for running the release. I did the following: - Browsed the javadoc - Browsed the protocol documentation - Ran the quickstart with ZK +1 (non-binding) Thanks, Andrew ________________________________________ From: Luke Chen < showuon@gmail.com > Sent: 06 December 2024 07:22 To: dev@kafka.apache.org < dev@kafka.apache.org > Cc: users@kafka.apache.org < users@kafka.apache.org >; kafka-clients < kafka-clients@googlegroups.com > Subject: Re: [VOTE] 3.7.2 RC1 Hi Matthias, Thanks for running the release. I did the following steps: - Validated the checksums and keys - Browsed the javadocs - Browsed the documentation - Ran all the quickstart using KRaft with kafka_2.13-3.7.2.tgz - Ran basic quickstart using 3.7.2-rc1 docker image +1 binding from me. Thanks. Luke On Fri, Dec 6, 2024 at 12:06 PM Matthias J. Sax <matthias@confluent.io.invalid> wrote: > Thanks Josep. Great i...

Hi Matthias, Thanks for running the release. I did the following steps: - Validated the checksums and keys - Browsed the javadocs - Browsed the documentation - Ran all the quickstart using KRaft with kafka_2.13-3.7.2.tgz - Ran basic quickstart using 3.7.2-rc1 docker image +1 binding from me. Thanks. Luke On Fri, Dec 6, 2024 at 12:06 PM Matthias J. Sax <matthias@confluent.io.invalid> wrote: > Thanks Josep. Great idea. > > Here is the draft PR link for docs updates: > https://github.com/apache/kafka-site/pull/652 > > > > Thanks Divij for talking a look and voting. > > If we need a new RC, happy to include the two tickets you mentioned. Too > bad that you did miss my original email proposing 3.7.2, in which I did > ask people to call out missing fixes for cherry-picking. > > > -Matthias > > > On 12/5/24 11:28 AM, Divij Vaidya wrote: > > ## Validations (on AArch64 ...