Re: can kafka state stores be used as a application level cache by application to modify it from outside the stream topology?
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCAAdFiEEI8mthP+5zxXZZdDSO4miYXKq/OgFAl6qeuMACgkQO4miYXKq
/Oi2+A//ftVA1eEasbi++XC0/7QnX0LMJc375izpCr6A7Piuyx6lZo/h1NiARwEu
96Z/HVnl/KRL6H9xHUpY4lEM7yvs+qwrFYcsWbxqa05TIaOmtY977WRB/mAnxU7C
GP/UAuIJ6kjygCwHwFvjfSQkhGYTmAqopMdA+guVxxlWuIEmH2ZqCbn7kN1h8vlD
oPD01ss4nJLWNcpERauQDkFB/23xSOxqE1tTzK0tb3MaEB/qRWJaCUFWMVXMOGCJ
R9GIVV/R+KcqYObMMo2HS2TOb9rDNmyisx9VIFWyEe8pfsgOMh1IZ0D5mHN9b10H
EWJRnQZ5s//goAfYZdQXNUE3QL0XiIjTWGMWE814JnVHINPt1coqQzdndgD8dFJS
Y034lPowaXltvZl0H7EV27WHO2Hvf6r9AO7i4dLZb8Apx8lillKsWotoi8a863wy
718ICRUixRrHh0e+BEoqaf+88dL+9jpSIaGJEeh7hyhqLmQ0omibMqB9aG8r1mHJ
mP8QyupYov0Y7vu97Fv/SZji/UkfWtrKneRKv0uLW/CUJPYhR7uvZKclxTIT5gGR
AsSZtqGIh13dw/6YgNzR1sPzFZGGYWDwQF58xBvRuMlgPNR5Ax7FrwGmHZ2vNOAI
KyO0J6I6DJ/oLopIHzrWo52ZmNd54bf0x8uP8MQ3d0coL7J5664=
=x8um
-----END PGP SIGNATURE-----
It's not possible to modify state store from "outside".
If you want to build a "replicated caching layer", you could use global
stores and write into the corresponding topics to update all stores. Of
course, those updates would be async.
-Matthias
On 4/29/20 10:52 PM, Pushkar Deole wrote:
> Hi All,
>
> I am wondering if this is possible: i have been asked to use state stores
> as a general replicated cache among multiple instances of service instances
> however the state store is created through streambuilder but is not
> actually modified through stream processor topology however it is to be
> modified from outside the stream topology. So, essentially, the state store
> is just to be created from streambuilder and then to be used as an
> application level cache that will get replicated between application
> instances. Is this possible using state stores?
>
> Secondly, if possible, is this a good design approach?
>
> Appreciate your response since I don't know the internals of state stores.
>
iQIzBAEBCAAdFiEEI8mthP+5zxXZZdDSO4miYXKq/OgFAl6qeuMACgkQO4miYXKq
/Oi2+A//ftVA1eEasbi++XC0/7QnX0LMJc375izpCr6A7Piuyx6lZo/h1NiARwEu
96Z/HVnl/KRL6H9xHUpY4lEM7yvs+qwrFYcsWbxqa05TIaOmtY977WRB/mAnxU7C
GP/UAuIJ6kjygCwHwFvjfSQkhGYTmAqopMdA+guVxxlWuIEmH2ZqCbn7kN1h8vlD
oPD01ss4nJLWNcpERauQDkFB/23xSOxqE1tTzK0tb3MaEB/qRWJaCUFWMVXMOGCJ
R9GIVV/R+KcqYObMMo2HS2TOb9rDNmyisx9VIFWyEe8pfsgOMh1IZ0D5mHN9b10H
EWJRnQZ5s//goAfYZdQXNUE3QL0XiIjTWGMWE814JnVHINPt1coqQzdndgD8dFJS
Y034lPowaXltvZl0H7EV27WHO2Hvf6r9AO7i4dLZb8Apx8lillKsWotoi8a863wy
718ICRUixRrHh0e+BEoqaf+88dL+9jpSIaGJEeh7hyhqLmQ0omibMqB9aG8r1mHJ
mP8QyupYov0Y7vu97Fv/SZji/UkfWtrKneRKv0uLW/CUJPYhR7uvZKclxTIT5gGR
AsSZtqGIh13dw/6YgNzR1sPzFZGGYWDwQF58xBvRuMlgPNR5Ax7FrwGmHZ2vNOAI
KyO0J6I6DJ/oLopIHzrWo52ZmNd54bf0x8uP8MQ3d0coL7J5664=
=x8um
-----END PGP SIGNATURE-----
It's not possible to modify state store from "outside".
If you want to build a "replicated caching layer", you could use global
stores and write into the corresponding topics to update all stores. Of
course, those updates would be async.
-Matthias
On 4/29/20 10:52 PM, Pushkar Deole wrote:
> Hi All,
>
> I am wondering if this is possible: i have been asked to use state stores
> as a general replicated cache among multiple instances of service instances
> however the state store is created through streambuilder but is not
> actually modified through stream processor topology however it is to be
> modified from outside the stream topology. So, essentially, the state store
> is just to be created from streambuilder and then to be used as an
> application level cache that will get replicated between application
> instances. Is this possible using state stores?
>
> Secondly, if possible, is this a good design approach?
>
> Appreciate your response since I don't know the internals of state stores.
>
Comments
Post a Comment