-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org
iQIzBAEBCgAdFiEE8osu2CcCCF5douGQu8PBaGu5w1EFAl26qdIACgkQu8PBaGu5
w1G/6A/9GjVaIUcor1RiEtG9LydAD8RcSvK7fGafSMFOlC44NTFkF/pP9MAUwMGT
eRXdv2xl9RFm9iZn1jbh3vSL9RTM0edkaEfenp+dBWYGYL9yQzYTyzoMnCQMTppP
2t/nGvXwIZuv4V8Rklfk1CyTuvA1CItYMXu5f9AQkv9I9X1aTaNbNBqFvbEHXJr7
UNdATf8Romxv5ruslNGpG1ahMG625PeLr9ITSmxszKSR9of8XqlR3W/2GYysiWKa
JQ99vy4yIATq6GiB8HC4r1oMBCziatiSy3PNzw46CHhB91X97Z65GbrGGB/4QWFH
7NBKgb5tMNsaGMXKTGFMg4pvhDAmqLWsdc9ngNpfSxWNld+AohAZxcVmj8o2MnyJ
d5VzNWrcFq4s7UTGH6bxif0KSFFlZ6SyNsCNkuoFZDpchWr+t9SF0Sy5hSLbM7sK
xhj1kS/TIkvp6cWX5IeDvmnaRDBN4CY28c7aomg/IVrt4+Ci23tx9nzuGS3zNr91
XZgBAjv3awtH+Xev9mzTR4oCZFDDh6XYRNn/+2WXidqIqrsi6toFDOT2/RoIC9XI
qojg3e2A36zzARwgbJFBQiHsYFR/Dy/950Moflvfkel1fJUlvLet2jJnTOQYaerM
5riVc3eZSv3eYmFSMmFbU2UuN1cOUnactj3hqmv7fvUiAuJKLX0=
=91cR
-----END PGP SIGNATURE-----
Btw: There is an example implementation of a custom daily window that
considers time zones. Maybe it helps:
https://github.com/confluentinc/kafka-streams-examples/blob/5.3.1-post/src/test/java/io/confluent/examples/streams/window/DailyTimeWindows.java
-Matthias
On 10/23/19 10:02 PM, 董宗桢 wrote:
> Hello Boyang,
>
>
> If I start the Kafka Stream process at the middle of a day, say, 10/24 16:00 pm, and with a tumbling window size of 1 day(24 hours). Would the next aggregation run at 10/25 00:00 AM? or at 10/25 16:00 PM?
>
>
>
>
>
>
>
>
> 在 2019-10-24 11:06:24，"Boyang Chen" <reluctanthero104@gmail.com> 写道：
>> Hey Zongzhen,
>>
>> I have implemented some similar functionality with KStream before. You
>> could just set tumbling window to 24 hours to get daily aggregation result.
>> As you just need calendar dates, the tumbling window computation starts
>>from system time 0 which is exactly cut-off daily.
>>
>> Boyang
>>
>> On Wed, Oct 23, 2019 at 7:21 PM 董宗桢 <jackdongdong@126.com> wrote:
>>
>>> Hello,
>>>
>>>
>>> I wanna run Kafka Streams on my system to aggregate the users' sales order
>>> transactions based on "daily".
>>> I know that Kafka Streams provides such mechanisms called tumbling window,
>>> but it seems to be just setting an interval to run the aggregation
>>> function. What I want is to aggregate by calendar date, which means, for
>>> example, from 10.23 00:00 AM to 10.24 00:00AM, kind of a scheduler which
>>> runs every day at 00:00AM to count all my transactions that happened last
>>> day.
>>>
>>>
>>> Is there any functionality in Kafka streams that I can use out of the box
>>> to implement my requirement?
>>>
>>>
>>> Thanks
Comment: GPGTools - https://gpgtools.org
iQIzBAEBCgAdFiEE8osu2CcCCF5douGQu8PBaGu5w1EFAl26qdIACgkQu8PBaGu5
w1G/6A/9GjVaIUcor1RiEtG9LydAD8RcSvK7fGafSMFOlC44NTFkF/pP9MAUwMGT
eRXdv2xl9RFm9iZn1jbh3vSL9RTM0edkaEfenp+dBWYGYL9yQzYTyzoMnCQMTppP
2t/nGvXwIZuv4V8Rklfk1CyTuvA1CItYMXu5f9AQkv9I9X1aTaNbNBqFvbEHXJr7
UNdATf8Romxv5ruslNGpG1ahMG625PeLr9ITSmxszKSR9of8XqlR3W/2GYysiWKa
JQ99vy4yIATq6GiB8HC4r1oMBCziatiSy3PNzw46CHhB91X97Z65GbrGGB/4QWFH
7NBKgb5tMNsaGMXKTGFMg4pvhDAmqLWsdc9ngNpfSxWNld+AohAZxcVmj8o2MnyJ
d5VzNWrcFq4s7UTGH6bxif0KSFFlZ6SyNsCNkuoFZDpchWr+t9SF0Sy5hSLbM7sK
xhj1kS/TIkvp6cWX5IeDvmnaRDBN4CY28c7aomg/IVrt4+Ci23tx9nzuGS3zNr91
XZgBAjv3awtH+Xev9mzTR4oCZFDDh6XYRNn/+2WXidqIqrsi6toFDOT2/RoIC9XI
qojg3e2A36zzARwgbJFBQiHsYFR/Dy/950Moflvfkel1fJUlvLet2jJnTOQYaerM
5riVc3eZSv3eYmFSMmFbU2UuN1cOUnactj3hqmv7fvUiAuJKLX0=
=91cR
-----END PGP SIGNATURE-----
Btw: There is an example implementation of a custom daily window that
considers time zones. Maybe it helps:
https://github.com/confluentinc/kafka-streams-examples/blob/5.3.1-post/src/test/java/io/confluent/examples/streams/window/DailyTimeWindows.java
-Matthias
On 10/23/19 10:02 PM, 董宗桢 wrote:
> Hello Boyang,
>
>
> If I start the Kafka Stream process at the middle of a day, say, 10/24 16:00 pm, and with a tumbling window size of 1 day(24 hours). Would the next aggregation run at 10/25 00:00 AM? or at 10/25 16:00 PM?
>
>
>
>
>
>
>
>
> 在 2019-10-24 11:06:24，"Boyang Chen" <reluctanthero104@gmail.com> 写道：
>> Hey Zongzhen,
>>
>> I have implemented some similar functionality with KStream before. You
>> could just set tumbling window to 24 hours to get daily aggregation result.
>> As you just need calendar dates, the tumbling window computation starts
>>from system time 0 which is exactly cut-off daily.
>>
>> Boyang
>>
>> On Wed, Oct 23, 2019 at 7:21 PM 董宗桢 <jackdongdong@126.com> wrote:
>>
>>> Hello,
>>>
>>>
>>> I wanna run Kafka Streams on my system to aggregate the users' sales order
>>> transactions based on "daily".
>>> I know that Kafka Streams provides such mechanisms called tumbling window,
>>> but it seems to be just setting an interval to run the aggregation
>>> function. What I want is to aggregate by calendar date, which means, for
>>> example, from 10.23 00:00 AM to 10.24 00:00AM, kind of a scheduler which
>>> runs every day at 00:00AM to count all my transactions that happened last
>>> day.
>>>
>>>
>>> Is there any functionality in Kafka streams that I can use out of the box
>>> to implement my requirement?
>>>
>>>
>>> Thanks
Comments
Post a Comment