Skip to main content

Re: MirorMaker 2 - Accessing State Store ChangeLogs

Hi All
Anybody has inputs on my question below ?

Regards,
Neeraj


> On 26 Oct 2021, at 7:12 am, Neeraj Vaidya <neeraj.vaidya@yahoo.co.in.invalid> wrote:
>
> Hello Experts
> Any comments on this ?
>
> Regards,
> Neeraj
>
>
>> On 24 Oct 2021, at 11:55 am, Neeraj Vaidya <neeraj.vaidya@yahoo.co.in> wrote:
>>
>> Hi All,
>> In an Active-Active MM2 (MirrorMaker 2) setup, I have the following Data Centres (DC1,DC2) :
>>
>> DC1:
>> Topic T1
>> Kafka Streams which consumes from T1 and updates a local state store (example : "MyStateStore"). the applicationId is "myapp".
>>
>> DC2:
>> Topic T1
>> The MM2 process replicates the records from T1 to DC1.T1 on this data centre.
>> MM2 also replicates myapp-MyStateStore-changelog to DC1.myapp-MyStateStore-changelog.
>>
>> MM2 configuration:
>> "sync.group.offsets.enabled = true".
>>
>> Questions :
>> When I failover "myapp" to the DC2, how will the application get access to the State Store ? In my code I can only specify the name of the statestore from which to consume.
>> Is there a way I can get access to the State Store in this site as well ?
>> My theory is that in DC2 will only have records in the change log topic called DC1.myapp-MyStateStore-changelog so all state is essentially lost when I failover to DC2.
>>
>> Regards.
>> Neeraj
>

Comments