[Fixed] Web331 offline

Posted in Downtime by

Web331 is currently offline. We’re working to restore service at this time and will update this post as soon as we have more information.

Update 21:09 UTC: The server is experiencing a massive DDOS attack and the current datacenter isn’t able to deal with an attack that size. We are going to migrate the server to a new machine in a datacenter with better DDOS protection. The server’s main IP address will change to 37.58.75.241. We have started transferring the data to the new machine.

Update 00:31 UTC: The data is still being copied to the new server (about 10% has been copied so far)

Update 06:30 UTC: The data is still being copied to the new server.

Update 10:30 UTC: The data is still being copied and we are working on putting the new server back online while the copy of the data finishes

Update 12:15 UTC: All mysql and postgresql databases have been copied over to the new server and the main services have been started on the new server. Home directories that start with the letter a to h have been copied over and their corresponding websites are now running. We are working on the rest of the home directories.

Update 17:47 UTC: Home directories that start with the letter a to l have now been copied over and their corresponding websites are now running. We are working on the rest of the home directories.

Update: 21:06 UTC: Home directories that start with the letter a to s have now been copied over and their corresponding websites are now running. We are working on the rest of the home directories.

Update: 23:50 UTC: All data has now been migrated. Please open a ticket if you notice any problem with your account or sites

-
-

[Done]Scheduled maintenance on Web57, November 1st, 2013.

Posted in Scheduled downtime by

Web57 will be taken down for a RAID firmware upgrade Friday 1st November at 12:30 UTC. The expected downtime should be less than 1 hour. We will update this post as maintenance progresses.

2013-11-01 13:42 UTC The RAID firmware has been upgraded, the adapter is still giving diagnostic messages, we’re investigating further.

2013-11-01 15:44 UTC We swapped the RAID adpater but still receiving diagnostic messages, we’re currently looking into it.

2013-11-01 16:24 UTC The swapped RAID adapter kept giving error messages, we’re now swapping the server chassis.

2013-11-01 19:45 UTC: An issue with the MAC address on the new chassis is preventing us from bringing the server back online. We’re working to resolve this at this time.

2013-11-01 20:00 The chassis has been swapped and the MAC address issue fixed. The server is back at operational status.

-
-

[Done]Scheduled maintenance on Web57, October 31st, 2013.

Posted in Scheduled downtime by

Web57 will be taken down Thursday October 31st between 13:30 UTC and 14:30 UTC for a RAID firmware update. We will update this post as maintenance progresses.

2013-10-31 14:21 UTC RAID firmware has been updated, the server is back to operational status.

-
-

[Done] Scheduled maintenance on web392, October 30th, 2013.

Posted in Downtime by

web392 will be taken down Wednesday October 30th between 7am-11am UTC for a cable swap and firmware upgrade. Expected downtime is 1 hour. We will update this post as maintenance progresses.

2013-10-30 07:25: Maintenance is complete and the server is back online.

-
-

[Done] Scheduled maintenance on web57, October 29th, 2013.

Posted in Downtime by

web57 will be taken down Tuesday October 29th at 1PM UTC for a routine cable swap. Expected downtime is 30 minutes. We will update this post as maintenance progresses.

2013-10-29 14:01: Maintenance is complete and the server is back online.

-
-

[Done] Web23 Server Reboot

Posted in Downtime by

We need to reboot the Web23 server due to some lingering kernel issues that are preventing some users from logging in.  We expect the server to be back online shortly.

Update:  Web23 is back online.

-
-

[Fixed] Emergency Maintenance on Web425

Posted in Downtime by

The MySQL service on Web425 is currently down. This is due to a disk issue and our System Administrators are working to restore service and will update this post with more information as soon as possible.

 

2013-10-19 1720 The issue on the server has been resolved and full service has been restored.

-
-

[Done]Scheduled maintenance on Web35, October 17th, 2013.

Posted in Scheduled downtime by

Web35 will be taken down Thursday October 17th between 08:00 UTC and 12:00 UTC for a RAID adapter configuration check . We will update this blog post as maintenance will progress.

2013-10-17 14:48 UTC Disk has been swapped after checking the RAID. The server is at operational status.

-
-

[Done]Emergency Maintenance on Web35

Posted in Downtime by

Currently the server is down for emergency maintenance. We are working on updating the RAID firmware.

We will post updates as progress continues.

2013-10-15 15:50 UTC While upgrading the RAID firmware a faulty disk needed to be replaced. The RAID is now rebuilding and the server is back at operational status.

-
-

[Fixed] Web427 Nginx urgent maintenance

Posted in Downtime by

Nginx is having some difficulty starting up.  We are working on a solution, and we expect the server to be back online soon.

Update:  Web427 is back online.

-
-