Skip to main content

Re: Kafa Streams

Yes, Kafka Consumer and Kafka Streams are just libraries. My point with that, is that it's not difficult to switch from one to the other as your needs evolve.

There are several ways that Kafka Streams aids in processing. It provides a rich set of functions for transforming, filtering, branching, etc. Also it manages state for any stateful processing, like aggregations, joins, etc. If you don't need any of these and are just consuming events and writing them to a database, Kafka Consumer will work fine. But if your needs change, you can switch to Kafka Streams later.

Also, if you really are just consuming to write to a DB, you may want to consider Kafka Connect.

Let me know if this is unclear.

Thanks,
Dave


> On Jun 26, 2021, at 7:05 AM, SuarezMiguelC <SuarezMiguelC@protonmail.com.invalid> wrote:
>
> DaveKlein, in the reply email of "Kafka Streams" on the question to use Kafka Streams or just a consumer you specified:
>
>> But Streams and Consumer are just libraries, so start with Consumer and if you find yourself doing more processing, consider moving to Kafka Streams.
>
> I though Kafka Consumer was also just a library, and didn't knew Streams helped with processing, can you elaborate on this?
>
> Thanks for sharing your knowledge!
>
> Miguel Suárez

Comments