[Done] Scheduled maintenance work on Web111 and Web115 on Friday October 1st

Posted in Scheduled downtime by

These three servers will be taken down on Friday October 1st  to fix a problem with the RAID controller. The downtime should be less than 1h. Web111 will be taken down at 11:00 UTC and Web115 at 11:30 UTC.

[Update] 11:10 UTC: We are bringing Web111 down.

[Update] 11:45 UTC: Web111 is fully operational again.

[Update] 11:55 UTC: We are bringing Web115 down.

[Update] 14:05 UTC: Web115 is fully operational again.

-
-

[Done] Scheduled maintenance work on Web9 on saturday October 2nd

Posted in Scheduled downtime by

Web9 will be taken down on Saturday October 2nd at 1pm UTC (08:00 CDT) to repair a failing RAID. The downtime should be less than 3h.

[13:05 UTC] Update: We are bringing Web9 down.

[18:26 UTC] Update: We have put a new RAID array with two new drives in the server and are now recovering all the data from the previous drive.

[20:58 UTC] Update: The server wasn’t recognizing the new RAID array so we aborted the work and will reschedule it for later.

-
-

[Fixed] Scheduled maintenance work on Web123, Web150 and Mailbox4 on Wednesday September 29th

Posted in Scheduled downtime by

These three servers will be taken down on Wednesday September 29th to fix a problem with the RAID controller. The downtime should be less than 1h. Web123 will be taken down at 10:00 UTC, Web150 at 11:00 UTC and Mailbox4 at 10:30 UTC.

[12:15]: Mailbox4 is back online

[12:45]: web123 is back online

[13:00]: web150 is back online

All servers are now back online.

-
-

[Done] Scheduled maintenance work on Web132 on Sunday September 26th

Posted in Scheduled downtime by

Web132 will be taken down on Sunday September 26th at 6pm UTC (13:00 CDT) to repair a degraded RAID. The downtime should be less than 1h.

Update: The server is now on-line.

-
-

[Done] Scheduled maintenance work on Web149 on Sunday September 26th

Posted in Scheduled downtime by

Web149 will be taken down on Sunday September 26th at 6pm UTC (13:00 CDT) to fix a problem with the RAID controller. The downtime should be less than 1h.

Update: The server is now on-line.

-
-

[Fixed] Bandwidth statistics unavailable

Posted in Problems by

The bandwidth statistics are currently unavailable from the control panel.

Update: bandwidth stats are available again

-
-

[Fixed] Web127 down for emergency maintenance

Posted in Downtime by

Web127 is currently down to a failing chassis. Our datacenter team are working on this right now and will have the server back up shortly.

[11:05]: The new chassis is now being swapped in.

[12:35]: The server is now back online and fully functional.

-
-

[Done] Web64 HDD upgrade on Sunday, September 12, 2010

Posted in Scheduled downtime by

Web64 will be taken down at 9pm UTC (16:00 CDT) on Sunday, September 12th, 2010 for a HDD upgrade. Total downtime should not exceed two hours. We’ll update this post as the work progresses.

Update: the work is now complete

-
-

[Fixed] Web37: Emergency maintenance

Posted in Downtime by

Web37 is currently down for an emergency maintenance. The engineers at our datacenter are working on the problem. We will update this post as soon as we have any news.

[11:25 AM UTC] Update: The server’s filesystem is corrupted. We are currently running disk checking utilities, attempting to restore the filesystem integrity.
[2:20 PM UTC] Update: The server’s filesystem could not be repaired. We are currently rebuilding the server using data from our latest backup.
[4.30 PM UTC] Update: The new server is ready and we have started recovering all the data from backup.
[6.20 PM UTC] Update: We are still recovering data from our backup servers
[9.50 PM UTC] Update: We are still recovering data from our backup servers
[12:05 AM UTC] Update: We are still recovering data from our backup servers
[5:00 AM UTC] Update: We are still recovering data from our backup servers
[9:15 AM UTC] Update: the recovery is now complete and the server is back online with yesterday’s backup data. If you notice any problems with your site open a ticket and we’ll look into it asap.

-
-