Kafka

Hi Avishek Das： To be honest, I don't currently have an environment to monitor the log to know the details logic for upload. Based on my code review, it appears that the task was created in my case. The similarities between my case and yours are: 1. Not all servers are affected. 2. The issue occurred after a restart. You could try the following method to see if it resolves the issue: 1. Upgrade Kafka to 4.2.0, which was just released this week. 2. If you don't want to upgrade kafka. Increase remote.log.metadata.initialization.retry.max.timeout.ms from 2 minutes to a larger value, such as 20 minutes and do restart. Maybe we can also wait whether other guys can have some other feedbacks for your issue. Thanks Regards Jian Avishek Das via users < users@kafka.apache.org > 于2026年2月18日周三 21:27写道： > Hello Jian, > > Thanks for sharing the references. > > I just wanted to confirm, did you encounter the same issue where the ...

Ok. Thanks for the clarification. On Thu, Feb 19, 2026 at 8:04 PM Chia-Ping Tsai < chia7712@gmail.com > wrote: > Hi Subra, > > It seems to me both use an async approach. The root cause is that the > returned error code is different. Please check > https://issues.apache.org/jira/browse/KAFKA-20089 for more details. > > Thanks, > Chia-Ping > > Subra I < iamsubra100@gmail.com > 於 2026年2月19日週四 下午9:58寫道： > > > Thanks for the response Lianet. > > > > This problem happens only in kraft mode brokers. Works fine if we use > kafka > > broker in non-kraft mode. (WIth zookeeper) > > > > From what I understand: (I may be wrong. this is what I read online) > > > > In zookeeper mode, on getting a partitionsFor request, the broker > creates a > > topic if not present and then immediately returns the number of > partitions. > > All this happens synchronously. ...

Hi Subra, It seems to me both use an async approach. The root cause is that the returned error code is different. Please check https://issues.apache.org/jira/browse/KAFKA-20089 for more details. Thanks, Chia-Ping Subra I < iamsubra100@gmail.com > 於 2026年2月19日週四 下午9:58寫道： > Thanks for the response Lianet. > > This problem happens only in kraft mode brokers. Works fine if we use kafka > broker in non-kraft mode. (WIth zookeeper) > > From what I understand: (I may be wrong. this is what I read online) > > In zookeeper mode, on getting a partitionsFor request, the broker creates a > topic if not present and then immediately returns the number of partitions. > All this happens synchronously. > > In kraft mode, the broker creates a topic asynchronously. So, unless u > retry, you wont get the total number of partitions. > > Like I said, this is what I read. > > On Tue, Feb 17, 2026 at 3:19 AM Lianet Magra...

Thanks for the response Lianet. This problem happens only in kraft mode brokers. Works fine if we use kafka broker in non-kraft mode. (WIth zookeeper) From what I understand: (I may be wrong. this is what I read online) In zookeeper mode, on getting a partitionsFor request, the broker creates a topic if not present and then immediately returns the number of partitions. All this happens synchronously. In kraft mode, the broker creates a topic asynchronously. So, unless u retry, you wont get the total number of partitions. Like I said, this is what I read. On Tue, Feb 17, 2026 at 3:19 AM Lianet Magrans < lianetm@apache.org > wrote: > Hi Anand, > > The partitionsFor API does not guarantee that a single call will return the > data if the topic does not exist. It issues a first metadata request to > create the topic, and waits for the api timeout for a response (timeout > param or default.api.timeout.ms config). Then returns whatever it...

Hi Avishek, Unfortunately, disabling tiered storage only works under KRaft mode. If you look closely at the KIP-950[1], you'll see this sentence (see the underlined section): > *Support for Both KRaft and Zookeeper-backed Clusters*: The tiered storage disablement feature should be designed and implemented to support both KRaft and Zookeeper-backed Kafka clusters, ensuring compatibility across different cluster configurations. Updated: *We will implement for KRaft only in v3.9.0.* I agree that the KIP itself seems to state that it will work with both. But in the end it was only implemented in KRaft mode. Also, one can see in the documentation PR[2] that it only mentions how to disable it in KRaft mode. Sorry this is not the answer you were looking for. [1]: https://cwiki.apache.org/confluence/display/KAFKA/KIP-950%3A++Tiered+Storage+Disablement [2]: https://github.com/apache/kafka/pull/16836/changes On Wed, Feb 18, 2026 at 1:53 PM Avishek Das via users...

Hello Jian, Thanks for sharing the references. I just wanted to confirm, did you encounter the same issue where the RLMCopyTask was created but did not copy segments to remote storage, or was the RLMCopyTask not created at all in your case? On Tue, Feb 17, 2026 at 8:48 AM jian fu < fujian1115@gmail.com > wrote: > Hi Avishek Das: > > Though I am not sure about your issue. but I encounter the similar issue > and fix it with: > > https://github.com/apache/kafka/pull/20007 > https://github.com/apache/kafka/pull/20203 > https://cwiki.apache.org/confluence/x/Hg9JFg > > You can refer to it to see if it is the same issue. thanks > > Regards > Jian > > Avishek Das via users < users@kafka.apache.org > 于2026年2月16日周一 21:32写道： > > > Hello Team, > > > > During tiered storage performance testing on Kafka 3.9.1, we observed > cases > > where a broker did not trigger scheduled RL...

Hello Community, As part of our testing, I am validating the scenario where tiered storage is disabled on a topic where it was previously enabled. I attempted to alter the topic configuration using the following configs: remote.storage.enable=true remote.log.copy.disable=true However, this results in an exception stating that remote.log.copy.disable is not valid in ZooKeeper mode. Caused by: org.apache.kafka.common.errors.InvalidConfigurationException: It is invalid to set `remote.log.delete.on.disable` or `remote.log.copy.disable` under Zookeeper's mode. We are running Kafka v3.9.1 on a ZooKeeper-backed cluster, and based on the KIP-950 < https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=263424654#KIP950:TieredStorageDisablement-StateTransitions > documentation, these configurations appear to be available for ZooKeeper-based clusters as well. Am I missing any prerequisite or additional step required to disable Tiered Storage ...