On 27/07/2021 09:19, Sridhar Rao wrote:
> Hi Everyone,
>
> Recently we noticed a high number of under-replicated-partitions after
> zookeeper split brain issue.
> We tried fixing the issue by executing ./kafka-reassign-partitions.sh
> procedure. However Kafka refuses to re-assign the partitions in ISR and
> un-repl partitions remain the same.
>
> Kafka version: Apache Kafka 1.0.0
>
> Any advice in this regard would be highly appreciated. Please feel free to
> request any missing information. Thank you!
>
Zookeeper needs a quorum to elect a leader therefore a split brain is unlikely. Can you describe how split brain occurred? (number of instances, what happened and how it was resolved)
Given that, if your topic/partitions topology did not change, (that I know) even a split brain should not affect your data, therefore your ISR.
Running the below command should tell you which partitions are under replicated
kafka-topics.sh --describe
I think it might be a good starting point to understand what is going on.
To blindly reassign partitions is in my experience not an ideal solution, because you will have data shuffling around unnecessarily.
regards,
fabio pardi
> Hi Everyone,
>
> Recently we noticed a high number of under-replicated-partitions after
> zookeeper split brain issue.
> We tried fixing the issue by executing ./kafka-reassign-partitions.sh
> procedure. However Kafka refuses to re-assign the partitions in ISR and
> un-repl partitions remain the same.
>
> Kafka version: Apache Kafka 1.0.0
>
> Any advice in this regard would be highly appreciated. Please feel free to
> request any missing information. Thank you!
>
Zookeeper needs a quorum to elect a leader therefore a split brain is unlikely. Can you describe how split brain occurred? (number of instances, what happened and how it was resolved)
Given that, if your topic/partitions topology did not change, (that I know) even a split brain should not affect your data, therefore your ISR.
Running the below command should tell you which partitions are under replicated
kafka-topics.sh --describe
I think it might be a good starting point to understand what is going on.
To blindly reassign partitions is in my experience not an ideal solution, because you will have data shuffling around unnecessarily.
regards,
fabio pardi
Comments
Post a Comment