The filesystem on Web178 suddenly went read-only. We are booting the server into rescue mode to run a filesystem check. We will update this post as maintenance progresses.
Update 16:06 UTC: The filesystem has some corruption so we are migrating the server to new hardware. Note that the main IP address will change from 220.127.116.11 to 18.104.22.168 so if you are using non-DNS servers for some of your domains you will have to update them to point your domains at the new IP.
Update 17:12 UTC: All MySql and PostgreSQL databases have been migrated to the new server as well as the first few home directories. All services have been started on the new server. We are working on migrating the rest of the home directories.
Update 22:10 UTC: All home directories starting with the letter a or b have been migrated. We’re working on the rest of the home directories.
Update 06:00 UTC: All home directories up to the letter p have been migrated. We’re working on the rest of the home directories.
Update 16:47 UTC: All home directories up to the letter t have been migrated. We’re working on the rest of the home directories.
Update 08:17 UTC: The migration is now finished. If you notice any problems with your account open a ticket and our support team will look into it asap.
The filesystem on Web178 went into a read-only state several minutes ago. We rebooted the server but it has not come back up yet. We’re investigating this issue now and will update this post when we have more information.
2011-06-10 20:24 UTC – A drive has failed on Web178. The drive is currently being replaced.
2011-06-10 21:24 UTC – The drive has been replaced. A filesystem check is currently running.
2011-06-10 21:49 UTC – The filesystem check is still in progress.
2011-06-11 00:30 UTC – The filesystem check is still in progress. Web178 has a 2TB disk, so the check will take a considerable amount of time to complete.
2011-06-11 02:30 UTC – The filesystem check is still in progress.
2011-06-11 04:45 UTC – The filesystem check has finished and the server is back online and responding to requests.
The filesystem on Web178 went into a read-only state several minutes ago. The server has failed to come back online after being rebooted.
We’re currently investigating this issue and hope to have service restored shortly. We will update this post with more information as it becomes available.
2011-04-01 20:55 UTC – Web178 is back online. The downtime was due to the server prompting for a manual filesystem check after it was rebooted. We’ve bypassed that for now and will schedule a full filesystem check in the near future.