Web70′s filesytem went read-only. We’re currently taking the server down to run a fsck. We will update this post as maintenance progresses.

2013-05-13 14:34 UTC: We are still running filesystem checks on the server.

2013-05-13 16:28 UTC: We are still running a filesystem check on the server.

2013-05-13 18:13 UTC: The filesystem check has stalled. We’ve already begun preparations to migrate the data that is available to a new server and the data for all $HOME directories is currently being transferred to the new server.

2013-05-13 19:17 UTC: Approximately 10% of the data has been transferred from the old server to the new server.

2013-05-13 21:08 UTC: We have cancelled the transfer of data from the old server. We’ve found problems with the data integrity. We’re now pulling data from our backups.

2013-05-13 22:47 UTC: We are still restoring data from backups.

2013-05-14 00:10 UTC: We have restored approximately 32% of the data from backups.

2013-05-14 02:13 UTC: We have restored approximately 35% of the data from backups.

2013-05-14 05:22 UTC: All MySQL and PostgreSQL databases and all user cron jobs have been transferred to the new server. We’re still migrating $HOME data.

2013-05-14 06:38 UTC: We are still restoring data from backups.

2013-05-14 10:20 UTC: All data has been restored and the server is back online.

2013-05-14 13.15 UTC: Contrary to what was previously announced some data is still missing and we are still in the progress of recovering it.

2013-05-14 15:03 UTC: We are still restoring data from backups.

2013-05-14 16:46 UTC: All MySql and PostgreSQL databases have now been recovered. Most of the home directories have been recovered too. We’re still working on the last few ones.

2013-05-15 03:05 UTC: At this time we have recovered as much data as possible from the old server.