Skip to main content

MirrorMaker 2.0 XDCR / KIP-382

I am attempting to setup a simple cross data center replication POC using the new mirror maker branch. The behavior is not quite what I was expecting, so it may be that I have made some assumptions in terms of deployment that are incorrect or my setup is incorrect (see below). When I run the two MMs, it seems like replication will work for one DC but not for the other. If I run MM2 on just one node and enable both pairs, then replication works as expected. However, that deployment does not match the described setup in the KIP-382 documentation.

Should I be using the MM driver to deploy in both DCs? Or do I need to use a connect cluster instead? Is my configuration (included below) possibly incorrect?

Thanks,

Jeremy Ford




Setup:

I have two data centers. I have MM2 deployed in both DCs on a single node. I am using the MIrrorMaker driver for the deployment. The configuration for both DCs is exactly the same, except the enabled flag.


Config File:

clusters: DC1,DC2
DC1.boostrap.servers = kafka.dc1
DC2.boostrap.servers = kafka.dc2

DC1->DC2.topics = test
DC2->DC1.topics = test


In DC1:

DC1->DC2.enabled=true
DC1->DC2.enabled=false

In DC2:

DC1->DC2.enabled=false
DC1->DC2.enabled=true

Comments