Kafka v0.11.0.2
Kafka broker was running in PST timezone for about a month and then due to OS patch, Admin changed the timezone to EST and after restart, we saw replay of consumer message (consumer offset got reset to 0). We asked Admins to change the timezone back to PST, they took 3 days to change it. After changing the timezone back to PST, during broker restart we saw the bellow log messages (even for Topics and __consumer_offsets -> WARN Found a corrupted index file due to requirement failed:)
Since __consumer_offsets got corrupted when Kafka broker was restarted due to timezone changes, does it really reset the consumer offset to 0? We again got replay of messages after this message.
WARN Found a corrupted index file due to requirement failed: Corrupt index found, index file (/app/kafka_2.12-0.11.0.2/data/__consumer_offsets-21/00000000000000002076.index) has non-zero size but the last offset is 2076 which is no larger than the base offset 2076.}. deleting /app/kafka_2.12-0.11.0.2/data/__consumer_offsets-21/00000000000000002076.timeindex, /app/kafka_2.12-0.11.0.2/data/__consumer_offsets-21/00000000000000002076.index, and /app/kafka_2.12-0.11.0.2/data/__consumer_offsets-21/00000000000000002076.txnindex and rebuilding index... (kafka.log.Log)
How do we solve consumer offset not going back to zero (0)?