Hi Kafka community,
We have an issue with our Kafka cluster from time to time, that a single (one and only one) broker (leader) in the cluster reaches 100% CPU utilisation. We could not see any apparent issue from the metrics. There is no heap memory usage increase, no excessive connections made on the broker, no misbehaving producers and consumers trying to dump or load excessively during these periods. The only difference we could see is that thread usage decreases during these period. Despite the problem, the service is still available (understandable from Kafka's perspective.)
We are trying to understand what else might be the cause of the issue and how we can mitigate them.
Tiansu Yu
Engineer
Data Ingestion & Streaming
Klarna Bank AB German Branch
Chausseestraße 117
10115 Berlin
Tel: +49 221 669 501 00
klarna.de
Klarna Bank AB, German Branch
Sitz: Berlin, Amtsgericht Charlottenburg HRB 217291 B
USt-Nr.: DE 815 867 324
Zweigstelle der Klarna Bank AB (publ), AG schwedischen Rechts mit Hauptsitz in Stockholm,
Schw. Gesellschaftsregister 556737-0431
Verwaltungsratsvorsitzender: Michael Moritz
Geschäftsführender Direktor: Sebastian Siemiatkowski
Leiter Zweigniederlassung: Yaron Shaer, Björn Petersen
Engineer
Data Ingestion & Streaming
Klarna Bank AB German Branch
Chausseestraße 117
10115 Berlin
Tel: +49 221 669 501 00
klarna.de
Klarna Bank AB, German Branch
Sitz: Berlin, Amtsgericht Charlottenburg HRB 217291 B
USt-Nr.: DE 815 867 324
Zweigstelle der Klarna Bank AB (publ), AG schwedischen Rechts mit Hauptsitz in Stockholm,
Schw. Gesellschaftsregister 556737-0431
Verwaltungsratsvorsitzender: Michael Moritz
Geschäftsführender Direktor: Sebastian Siemiatkowski
Leiter Zweigniederlassung: Yaron Shaer, Björn Petersen
Comments
Post a Comment