Something's broken on our main fileserver. It's related to our disk array. We're working on fixing it. More news as it happens. Lots of stuff may be broken until we get it back up.
Update 7:10pm: We've had a disk failure, and the raid volume got unhappy. We don't think we've lost any important data, but are verifying. Things are going slow because it takes a while to check half a terabyte of data.\
Update 11:40pm: This is taking a while to resync and fsck. (Plus we accidentally aborted it halfway through.) We're going to go to bed, we'll try and have services back in the morning.
No comments:
Post a Comment