Re: MM2 max.request.size setting

Even with the errors complaining, it does appear to have worked. Thanks much!

James Lavoy

Senior Infrastructure Engineer
Verizon - Protectwise

1601 Wewatta Street
#700
Denver, Co

> On Aug 31, 2020, at 2:16 PM, nitin agarwal <nitingarg456@gmail.com> wrote:
>
> I am not sure why it is picked in ConsumerConfig also. But you can verify
> in producer configuration that MM2 writes in logs.
>
> Thanks,
> Nitin
>
> On Tue, Sep 1, 2020 at 1:14 AM James Lavoy
> <james.lavoy@protectwise.com.invalid> wrote:
>
>> Are you sure this is the proper syntax?
>>
>> [2020-08-31 19:44:11,074] WARN The configuration
>> 'override.max.request.size' was supplied but isn't a known config.
>> (org.apache.kafka.clients.consumer.ConsumerConfig:362)
>> max.request.size = 1048576
>>
>> Seeing this in output after adding those values.
>>
>> James Lavoy
>>
>> Senior Infrastructure Engineer
>> Verizon - Protectwise
>>
>> 1601 Wewatta Street
>> #700
>> Denver, Co
>>
>>> On Aug 31, 2020, at 1:08 PM, nitin agarwal <nitingarg456@gmail.com>
>> wrote:
>>>
>>> If you have clusters like DC1 and DC2 then you can add the following
>>> configuration:
>>> DC1->DC2.producer.override.max.request.size=6291456
>>>
>>> Thanks,
>>> Nitin
>>>
>>> On Tue, Sep 1, 2020 at 12:35 AM James Lavoy
>>> <james.lavoy@protectwise.com.invalid> wrote:
>>>
>>>> Through the connect-mirror-maker.sh helper script.
>>>>
>>>> James Lavoy
>>>>
>>>> Senior Infrastructure Engineer
>>>> Verizon - Protectwise
>>>>
>>>> 1601 Wewatta Street
>>>> #700
>>>> Denver, Co
>>>>
>>>>> On Aug 31, 2020, at 1:04 PM, nitin agarwal <nitingarg456@gmail.com>
>>>> wrote:
>>>>>
>>>>> How are you running MM2 ?
>>>>>
>>>>> Thanks,
>>>>> Nitin
>>>>>
>>>>> On Mon, Aug 31, 2020 at 11:23 PM James Lavoy
>>>>> <james.lavoy@protectwise.com.invalid> wrote:
>>>>>
>>>>>> Good day,
>>>>>>
>>>>>> I'm trying to use MM2 to setup replication between two Kafka
>> clusters, I
>>>>>> have hit an issue that I believe is because of hitting the
>>>> ProducerConfig
>>>>>> max.request.size setting, however I seem unable to find the proper
>>>> string
>>>>>> to override the default setting in the mm2 config.
>>>>>>
>>>>>> This is the specific value I'm talking about:
>>>>>> [2020-08-31 15:42:17,066] INFO ProducerConfig values:
>>>>>> max.request.size = 1048576
>>>>>> Does anybody know off-hand the right config line to override this
>> limit?
>>>>>>
>>>>>> Thank you for your time and attention.
>>>>>>
>>>>>>
>>>>>>
>>>>>> James Lavoy
>>>>>>
>>>>>> Senior Infrastructure Engineer
>>>>>> Verizon
>>>>>>
>>>>>>
>>>>>>
>>>>
>>>>
>>
>>