[Fixed] Mail5 down

Posted in Downtime by

Our mail5 server is currently offline due to filesystem errors. We’re working to back up the data before we attempt any filesystem repairs. We’ll update this post as soon as we have more information.

2014-02-26 02:42 UTC: We’re currently checking mail5 RAID status and provisioning a new RAID card. We’ll update this post as soon as we have more information.

2014-02-26 04:04 UTC: We replaced the RAID card on mail5, at this moment all services on mail5 are functional.

-
-

Emergency Maintenance for Mail5

Posted in Downtime by

Mail5 will be taken down shortly for an emergency hard drive replacement. We’ll update this post as maintenance progresses.

2013-11-24 1800 UTC the failing hard drive has been replaced, however the datacenter is replacing the RAID Controller now.

2013-11-24 21:54 UTC We are making a complete backup of the machine just in case the degraded RAID array causes data loss from the new disk.

2013-11-24 02:31 UTC We are still copying data from the degraded RAID array to the new one.

2013-11-24 06:12 UTC Data transfer still in progress.

2013-11-25 12:04 UTC The machine has been rebooted and RAID is rebuilding. The server is at operational status.

-
-

[Postponed] Scheduled maintenance on Mail5, June 20th, 2013.

Posted in Scheduled downtime by

Mail5 will be taken down to swap a failing disk drive Thursday 20th June, 2013 between 07:00UTC and 10:00UTC. We will update this blog post as maintenance will progresses.

2013-06-20 11:26 UTC The disk has been swapped but the rebuild process has not started. We’re currently investigating the RAID adapter for possible issues.

2013-06-20 14:36 UTC We had to put the original drive back in place to let the RAID complete a rebuild and make the RAID ready to have a new swapped disk. The next scheduled maintenance will be at Friday 21st June 2013 between 07:00UTC and 10:00 for taking down the server and replace the drive. All services are back online but performance may be slightly degraded while the RAID rebuilds.

Update: This maintenance has been postponed. We’ll make a new post to announce the new date and time.

-
-

[Fixed] Emergency disk swap for Mail5

Posted in Downtime by

One of the server’s disks is failing so we are getting it replaced by the datacenter.

We will update this post with the status as the maintenance goes.

10:53:07 UTC: The disk has been replaced and the server is back and OK now.

-
-

[Done] Scheduled work on Mail5 and Web11

Posted in Scheduled downtime by

We will be investigating the cause of visual alarms on mail5.webfaction.com and web11.webfaction.com at 30 Dec 2009 0400 GMT-6.

Depending on the severity we might have to take the server down and if so it will be down between a few minutes and a few hours. We will update this ticket as soon as we have more information tomorrow.

-
-