Re: Error creating a topic with 10k partitions but not altering existing topic to 10k partitions? Why

Hi,

I have never seen PolicyViolationException before with vanilla Kafka. What
is the flavor?

This may caused by the controller mutation rate checks introduced by
KIP-599, it may be triggered for non-existing topics but not for the
existing resources.

Hope this help you track it down.

OSB

On Thu, Jul 11, 2024, 08:04 Brebner, Paul <Paul.Brebner@netapp.com.invalid>
wrote:

> Hi – just curious if anyone can suggest why the following occurs:
>
> 1 – try to create a topic with 10,000 partitions with Kafka CLI
> (kafka-topics.sh)
> Fails with ERROR org.apache.kafka.common.errors.PolicyViolationException:
> Unable to perform excessively large batch operation.
>
> 2- create a topic with 1 partition with Kafka CLI, and alter to 10k
> partitions - works fine
>
> Paul
>
>
>