Web42 audible alarm (fixed)

Posted in Downtime by

Web42 is currently down while we investigate an audible alarm. We’ll update this post once we know more about the issue.

Update: The problem was a degraded RAID on the server. The server is now back online and the RAID is rebuilding in the background.

-
-

Web59 Down (fixed)

Posted in Downtime by

Web59 is currently inaccessible and we’re looking into it.

Update: The problem was a misconfiguration in the firewall and it is now fixed.

-
-

Memory upgrade on Web64 (done)

Posted in Scheduled downtime by

Web64 will be down for a few minutes tomorrow at 9am GMT while we add more memory to the server.

Update: The upgrade is now over

-
-

Emails rejected by hotmail (fixed)

Posted in Downtime by

E-mails sent through our e-mail platform are currently rejected by Hotmail. We are currently talking to the Hotmail team to get this resolved as soon as possible. We will update this post once it is fixed.

Update: We are still working with Hotmail and the ban should be lifted tomorrow at the latest.

Update (4.09am GMT): E-mails to Hotmail are now going through again.

-
-

Web 69 Down (fixed)

Posted in Downtime by

Web 69 is currently down. Its root partition went read only and rebooting it revealed an issue which we are currently working on resolving now. We will post updates as they are available.

It appears to be an issue with the RAID controller and we are currently replacing the hardware and restoring all data from backup.

2009-03-09 06:00 PST: Web69 is still down having suffered a serious RAID controller failure. We have recovered all of the data from the server and are currently working on restoring it to a new standby server which will replace web69.

2009-03-09 06:16 PST: Web69 is now back online with all its data. We decided to move the data onto a new server to give us more time to check the hardware on the failing server. We copied all the data from just before the crash so no data has been lost.

-
-