36

So at this moment (but most likely not for long) Reddit, Meetup, Fark, LinkedIn, Yelp, 4Chan are all down. Netflix apparently was out for a while too.

According to Reddit's tweet, they are having issues relating to the Leap Second from 6/30/2012: https://twitter.com/redditstatus/status/219244389044731904

"We are having some Java/Cassandra issues related to the leap second at 5pm PST. We're working as quickly as we can to restore service."

Apparently, the issues affecting the other sites are all related to a leap second issue.

After reading Wikipedia article on Leap seconds, I think I understand what leap seconds are... but what I don't get is what kind of weird behaviors can happen if leap second isn't accounted for? And how, as programmers, should we prepare for leap seconds when we code and configure servers?

I mean it's only one second isn't it?

2
  • 1
    For the record, Yelp was no longer down by the time you posted this question.
    – Amber
    Jul 1, 2012 at 2:08
  • 3
    the east coast is getting hit by a big storm that is leaving millions without power and also took out a big data center used by amazon (Amazon’s Elastic Compute Cloud in North Virginia), reedit, netflix, and a lot others, this is also the reason why a lot of web sites are down today.
    – compcobalt
    Jul 1, 2012 at 2:17

2 Answers 2

25

Certain Linux kernels (versions before 2.6.29) have issues handling leap seconds, to the point where it can cause a kernel panic. Other Linux kernels can suffer from a livelock. This obviously has detrimental effects for the system, given that it requires a reboot.

Here's the related ServerFault question on this topic, since it's really a Linux server issue.

5
  • 6
    Why? What is about a leap second that causes a kernel panic? Jul 1, 2012 at 2:16
  • 2
    The kernel code that handles the leap second message from ntp is buggy. (If you want a more detailed explanation, I'd recommend reading the linked mailing list entries/bug reports.)
    – Amber
    Jul 1, 2012 at 2:18
  • 1
    marked as correct answer, but it would be nice if the specific problem was also put in the answer! thanks @Amber !
    – K2xL
    Jul 1, 2012 at 13:46
  • 1
    See also stackoverflow.com/questions/11260310/…
    – Ben
    Jul 2, 2012 at 15:19
  • 1
    For java related high-cpu usage. Try the ff fix. bugzilla.mozilla.org/show_bug.cgi?id=769972 Jul 3, 2012 at 1:32
0

On most systems I've seen (routers), one issue is either the uptime (time the system has been up) xor the boottime (the time the system booted) will be wrong by 1 second if a leap second was crossed. Also, logs at 23:59:60 are wrongly stamped with 23:59:59. Protocol timers are not affected. NTP falls out of sync and steps the clock to correct it--this takes several minutes in accordance with NTP rules.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.