Hi,
I think SMTs (KIP-66) could work for your case.
https://kafka.apache.org/documentation.html#connect_transforms
Regards,
OSB
On Fri, Nov 15, 2024, 03:03 Surbhi Mungre <mungre.surbhi@gmail.com> wrote:
> Can Kafka Connect be used to read messages from one Kafka Cluster, apply
> some basic transformation and write messages to another Kafka Cluster? I
> did not find a Kafka Connect Connector in the list of connectors provided
> by Confluence[1]. I only found a Replicator[2] but for my use-case I want
> to apply some transformation on the messages.
>
> Instead of using Kafka Connect, does it make more sense to use Kafka
> Streams or Spark Streaming. I want to perform very simple transformations.
>
> [1] https://www.confluent.io/product/connectors/
> [2]
> https://docs.confluent.io/platform/current/multi-dc-deployments/replicator/
>
> Thanks,
> -Surbhi
>
I think SMTs (KIP-66) could work for your case.
https://kafka.apache.org/documentation.html#connect_transforms
Regards,
OSB
On Fri, Nov 15, 2024, 03:03 Surbhi Mungre <mungre.surbhi@gmail.com> wrote:
> Can Kafka Connect be used to read messages from one Kafka Cluster, apply
> some basic transformation and write messages to another Kafka Cluster? I
> did not find a Kafka Connect Connector in the list of connectors provided
> by Confluence[1]. I only found a Replicator[2] but for my use-case I want
> to apply some transformation on the messages.
>
> Instead of using Kafka Connect, does it make more sense to use Kafka
> Streams or Spark Streaming. I want to perform very simple transformations.
>
> [1] https://www.confluent.io/product/connectors/
> [2]
> https://docs.confluent.io/platform/current/multi-dc-deployments/replicator/
>
> Thanks,
> -Surbhi
>
Comments
Post a Comment