Web385 experienced a kernel panic a short while ago. We have rebooted the server but it is showing filesystem errors so we are taking the server down to run a fsck. We will update this post as maintenance progresses.
2013-05-20 08:28 UTC FSCK completed, the server is back to operational status.
Web70′s filesytem went read-only. We’re currently taking the server down to run a fsck. We will update this post as maintenance progresses.
2013-05-13 14:34 UTC: We are still running filesystem checks on the server.
2013-05-13 16:28 UTC: We are still running a filesystem check on the server.
2013-05-13 18:13 UTC: The filesystem check has stalled. We’ve already begun preparations to migrate the data that is available to a new server and the data for all $HOME directories is currently being transferred to the new server.
2013-05-13 19:17 UTC: Approximately 10% of the data has been transferred from the old server to the new server.
2013-05-13 21:08 UTC: We have cancelled the transfer of data from the old server. We’ve found problems with the data integrity. We’re now pulling data from our backups.
2013-05-13 22:47 UTC: We are still restoring data from backups.
2013-05-14 00:10 UTC: We have restored approximately 32% of the data from backups.
2013-05-14 02:13 UTC: We have restored approximately 35% of the data from backups.
2013-05-14 05:22 UTC: All MySQL and PostgreSQL databases and all user cron jobs have been transferred to the new server. We’re still migrating $HOME data.
2013-05-14 06:38 UTC: We are still restoring data from backups.
2013-05-14 10:20 UTC: All data has been restored and the server is back online.
2013-05-14 13.15 UTC: Contrary to what was previously announced some data is still missing and we are still in the progress of recovering it.
2013-05-14 15:03 UTC: We are still restoring data from backups.
2013-05-14 16:46 UTC: All MySql and PostgreSQL databases have now been recovered. Most of the home directories have been recovered too. We’re still working on the last few ones.
2013-05-15 03:05 UTC: At this time we have recovered as much data as possible from the old server.
One of our customer mailbox servers (mailbox 10) is currently offline. Affected customers are not able to access their email via POP, IMAP, or Webmail at this time. We’re working to restore service and will update this post when we have more information.
2013-05-12 1400 UTC The server was manually rebooted by the datacenter and has returned to normal operation status.
On Friday, 10 May 2013 from 01:30 – 03:00 a.m. UTC we’ll be performing maintenance on some of our support systems. During this maintenance window https://webmail.webfaction.com, https://help.webfaction.com, and http://docs.webfaction.com/ may be offline or inaccessible. We will update this post as maintenance progresses.
2013-05-10 02:01 UTC: We are beginning the maintenance now.
2013-05-10 02:36 UTC: We are cancelling this maintenance and will reschedule.