Wednesday, January 8, 2014

Multiple Hard Drive Faliure

We've lost several of the drives from the machine that hosts PAUSE.  It's offline while we work to replace the drives and convince it to come back up.

Update 1/8/2013 5:49pm EST:  No good news so far.  We may need to restore from a backup.   <distraction>Did you hear that github was down?</distraction>

Update 1/10/2013 1:26am EST:  We're working to get PAUSE back up as soon as we can and apologize for any inconvenience this outage may be causing you.  It is taking a little longer than normal due to circumstances that are limiting our availability this week.  (i.e. bad timing for a failure.)

Update 1/11/2013 12:04pm EST: PAUSE is back up!  Thanks for your patience!


  1. : last release 3 days ago. Very sad :(

  2. Thank you very much for this work.

    Hope PAUSE be online soon.

  3. Well done, and thank you to everyone who helped restore, and indeed help with the day-to-day running of PAUSE

  4. Thanks to everyone involved for your work in getting this back up again, and for providing this service in the first place!

  5. Thanks to all involved. You don't realize how much you rely on something until it is not available.

  6. Thanks for your work. All DRs are a bummer and never well timed per Murphy, and he was an optimist. :D

  7. Thanks for your efforts in restoring PAUSE (and for the constant maintenance of the Perl infrastructure).

  8. Hi everyone – the failure had particular bad timing in that Robert and I were both traveling when it happened.

    Robert did the initial debugging and attempts to recover the drives remotely with our friends at doing the physical work.

    When we gave up on that I was back in California and started copying the latest backup to a newly built virtual machine.

    When all that was done Andreas re-indexed and otherwise fixed the database delta between the last backup and when the box crashed using data from the master CPAN mirror and I am guessing the modules mailing list archive.

    1. Also, thank you for the kind words and encouragement everyone.