Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Kafka Streams - Global State Store restoration before stream threads starts processing

I have Global State Store attached my topology. Global state store in reading from compacted topic. This global state store stores 100,000 records and these records should be there in state store for correct processing of the topology.

Question: Q. During application restart, kafka streams will start the global state store thread and make sure that the state is fully built before starting streams threads ?

I am trying to find some documentation related to this topic Please point me to code or documentation also.

like image 267
SunilS Avatar asked Jan 20 '26 05:01

SunilS


1 Answers

It depends if there is still any state remaining in the state.dir local filesystem for your application.id.

If there is, it'll start rebuilding data onto there. Otherwise, the beginning of the topic will have to be consumed to recreate that data

like image 128
OneCricketeer Avatar answered Jan 23 '26 13:01

OneCricketeer



Donate For Us

If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!