Hello,
We are exploring using Kafka for our application. Our requirement is that
once we write some messages to Kafka, it should be guaranteed that the
messages are persisted to disk.
We found this
<https://www.quora.com/Does-Kafka-sync-data-to-disk-asynchronously-like-Redis-does>
article which says that a Kafka broker acknowledges a record after it has
written the record to the buffer of the I/O device; it does not issue an
explicit fsync operation nor does it wait for the OS to confirm that the
data has been written. Is this statement true for the current
implementation? If so, is there any way in which we can ensure fsync is
called before acknowledgement of messages?
Any help would be appreciated.
--
Thanks & Regards
Kunal Goyal
We are exploring using Kafka for our application. Our requirement is that
once we write some messages to Kafka, it should be guaranteed that the
messages are persisted to disk.
We found this
<https://www.quora.com/Does-Kafka-sync-data-to-disk-asynchronously-like-Redis-does>
article which says that a Kafka broker acknowledges a record after it has
written the record to the buffer of the I/O device; it does not issue an
explicit fsync operation nor does it wait for the OS to confirm that the
data has been written. Is this statement true for the current
implementation? If so, is there any way in which we can ensure fsync is
called before acknowledgement of messages?
Any help would be appreciated.
--
Thanks & Regards
Kunal Goyal
Comments
Post a Comment