39

I was googling and reading Kafka documentation but I couldn't find out the max value of a consumer offset and whether there is offset wraparound after max value. I understand offset is an Int64 value so max value is 0xFFFFFFFFFFFFFFFF. If there is wraparound, how does Kafka handle this situation?

2 Answers 2

52

According to this post, the offset is not reset:

We don't roll back offset at this moment. Since the offset is a long, it can last for a really long time. If you write 1TB a day, you can keep going for about 4 million days.

Plus, you can always use more partitions (each partition has its own offset).

So as Luciano said, probably not worth worrying about.

2
  • 27
    Yup. Just like Y2K :)
    – Nick
    Commented Nov 4, 2017 at 23:38
  • 1
    I think we'll have to worry about it in the following 10 years.
    – rodolk
    Commented Dec 10, 2019 at 6:32
4

It seems that this is not really "handled". But, taking into account that the offset is per partition, it seems this is something we should not worry about :)

Please see http://search-hadoop.com/m/uyzND1uRn8D1sSH322/rollover/v=threaded

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.