I am attempting to setup a simple cross data center replication POC using the new mirror maker branch. The behavior is not quite what I was expecting, so it may be that I have made some assumptions in terms of deployment that are incorrect or my setup is incorrect (see below). When I run the two MMs, it seems like replication will work for one DC but not for the other. If I run MM2 on just one node and enable both pairs, then replication works as expected. However, that deployment does not match the described setup in the KIP-382 documentation.
Should I be using the MM driver to deploy in both DCs? Or do I need to use a connect cluster instead? Is my configuration (included below) possibly incorrect?
Thanks,
Jeremy Ford
Setup:
I have two data centers. I have MM2 deployed in both DCs on a single node. I am using the MIrrorMaker driver for the deployment. The configuration for both DCs is exactly the same, except the enabled flag.
Config File:
clusters: DC1,DC2
DC1.boostrap.servers = kafka.dc1
DC2.boostrap.servers = kafka.dc2
DC1->DC2.topics = test
DC2->DC1.topics = test
In DC1:
DC1->DC2.enabled=true
DC1->DC2.enabled=false
In DC2:
DC1->DC2.enabled=false
DC1->DC2.enabled=true
Should I be using the MM driver to deploy in both DCs? Or do I need to use a connect cluster instead? Is my configuration (included below) possibly incorrect?
Thanks,
Jeremy Ford
Setup:
I have two data centers. I have MM2 deployed in both DCs on a single node. I am using the MIrrorMaker driver for the deployment. The configuration for both DCs is exactly the same, except the enabled flag.
Config File:
clusters: DC1,DC2
DC1.boostrap.servers = kafka.dc1
DC2.boostrap.servers = kafka.dc2
DC1->DC2.topics = test
DC2->DC1.topics = test
In DC1:
DC1->DC2.enabled=true
DC1->DC2.enabled=false
In DC2:
DC1->DC2.enabled=false
DC1->DC2.enabled=true
Comments
Post a Comment