Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Max number of messages that can be stored in a Kafka topic partition?

Tags:

apache-kafka

I have a retention policy set for 48 hours. So old logs are eventually flushed. But topic's offset number keeps growing. When does this number get reset? What happens when the max offset number is reached? Also, new segments are rolled with base offset as filename at the time of creating new segment.What will be the filenames of .log and .index files when this limit is reached?

The following is the current base offset for log segment : current base offset for log segment

like image 602
Hemanth Malla Avatar asked Jan 05 '23 15:01

Hemanth Malla


1 Answers

The offset is never reset because the max offset value is so big (int64) that you won't ever reach it.

like image 153
Hans Jespersen Avatar answered Jan 29 '23 09:01

Hans Jespersen