Console consumer crashing

Hi folks,

I was troubleshooting a program trying to receive a kafka message (local
kafka, for development), and decided I needed to verify kafka itself was
happy. So I created a topic named 'fubar' and started the consumer
listening to it. Then I started the console producer in another terminal
window and typed in foo<return> and it appeared nicely on the consumer
terminal. Then I typed bar<return> and got this:

NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-consumer.sh
--bootstrap-server localhost:9092 --topic fubar --from-beginning

foo

[2024-05-29 11:56:07,183] ERROR Error processing message, terminating
consumer process: (kafka.tools.ConsoleConsumer$)

org.apache.kafka.common.protocol.types.SchemaException: Buffer underflow
while parsing response for request with header RequestHeader(apiKey=FETCH,
apiVersion=16, clientId=console-consumer, correlationId=608,
headerVersion=2)

at
org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:758)

at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:929)

at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594)

at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281)

at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:252)

at
org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.pollForFetches(LegacyKafkaConsumer.java:686)

at
org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:617)

at
org.apache.kafka.clients.consumer.internals.LegacyKafkaConsumer.poll(LegacyKafkaConsumer.java:590)

at
org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:874)

at
kafka.tools.ConsoleConsumer$ConsumerWrapper.receive(ConsoleConsumer.scala:473)

at kafka.tools.ConsoleConsumer$.process(ConsoleConsumer.scala:103)

at kafka.tools.ConsoleConsumer$.run(ConsoleConsumer.scala:77)

at kafka.tools.ConsoleConsumer$.main(ConsoleConsumer.scala:54)

at kafka.tools.ConsoleConsumer.main(ConsoleConsumer.scala)

Caused by: java.nio.BufferUnderflowException

at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)

at java.base/java.nio.HeapByteBuffer.getInt(HeapByteBuffer.java:402)

at
org.apache.kafka.common.protocol.ByteBufferAccessor.readInt(ByteBufferAccessor.java:43)

at
org.apache.kafka.common.message.ResponseHeaderData.read(ResponseHeaderData.java:90)

at
org.apache.kafka.common.message.ResponseHeaderData.<init>(ResponseHeaderData.java:66)

at
org.apache.kafka.common.requests.ResponseHeader.parse(ResponseHeader.java:100)

at
org.apache.kafka.common.requests.AbstractResponse.parseResponse(AbstractResponse.java:100)

at
org.apache.kafka.clients.NetworkClient.parseResponse(NetworkClient.java:756)

... 13 more

[2024-05-29 11:56:07,183] ERROR [Consumer clientId=console-consumer,
groupId=console-consumer-59661] Heartbeat thread failed due to unexpected
error (org.apache.kafka.clients.consumer.internals.ConsumerCoordinator)

java.lang.IllegalStateException: There are no in-flight requests for node 0

at
org.apache.kafka.clients.InFlightRequests.requestQueue(InFlightRequests.java:62)

at
org.apache.kafka.clients.InFlightRequests.completeNext(InFlightRequests.java:70)

at
org.apache.kafka.clients.NetworkClient.handleCompletedReceives(NetworkClient.java:927)

at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:594)

at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.poll(ConsumerNetworkClient.java:281)

at
org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient.pollNoWakeup(ConsumerNetworkClient.java:322)

at
org.apache.kafka.clients.consumer.internals.AbstractCoordinator$HeartbeatThread.run(AbstractCoordinator.java:1490)

Processed a total of 1 messages

NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$


Any idea what's happening? Certainly doesn't look copacetic.

Producer was started like this:

NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-topics.sh --list
--bootstrap-server localhost:9092

__consumer_offsets

fubar

NS2-MacBook-Pro:kafka_2.13-3.7.0 gus$ bin/kafka-console-producer.sh
--bootstrap-server localhost:9092 --topic fubar

>foo

>bar

>

-Gus

Founder, Chief Architect, Needham Software LLC
Commiter & PMC member Apache Solr & Apache Lucene
508-333-5312
https://www.needhamsoftware.com