Scheduled down time on Web 60 on Sunday.

Posted in Scheduled downtime by

On Sunday at 6 PM GMT we will be taking Web 60 down to install a new RAID array. We expect the down time to last between 2 and 4 hours.

[07:00 PM GMT] Update: Done

-
-

Scheduled maintenance on web44 and web45

Posted in Downtime by

As part of our ongoing commitment to ensuring the best power and network connectivity for our customers the following outages will happen this weekend :

web44 – February 26, 2010, between 12:01am and 4:00am CST
web45 – February 27, 2010, between 12:01am and 4:00am CST

Due to the large volume of machines that will be rebooted in this upgrade we cannot guarantee the specific time within that window ,
it is however a quick process and will take less than 60 minutes per machine.

Please accept our apologies for any disruption caused and rest assured that our support staff will be will be on hand to ensure minimum disruption.

If you have any questions please contact our support staff who will be happy to assist you.

Update (Feb 26, 04:15 CST): Web44 is now offline.
Update (Feb 26, 08:30 CST): Due to unforeseen problems, the maintenance of Web44 took longer than expected. The server is now fully operational again.

-
-

[Done] Web81 down for HDD upgrade

Posted in Downtime by

Web81 is currently non-operational, as the server’s Hard Drive is being upgraded. We expect to have the server fully operational again within 2 hours.

Update (10:10 am GMT): The upgrade is over, and the server is fully operational again.

-
-

[Done] Scheduled work on Mail5 on Sunday

Posted in Scheduled downtime by

We will be adding some new drives to Mail5 on Sunday Feb 21st at 4pm GMT.

The downtime should only be a few minutes and we will update this ticket when the work is completed.

Update (4pm GMT): The server is going down for scheduled maintenance.

Update (5:20pm GMT): The new drives have been added. While adding them we noticed a degraded drive and are replacing it now.

Update (6pm GMT): Done

Update (6:26pm GMT): The server is under high load as it is catching up for the time it was down. We will continue to monitor the server until it normalizes.

-
-

[Done] Disk replacement on Web7

Posted in Scheduled downtime by

Web7 will be down for approximately 1 hour beginning at 4:30 AM US CST (11:30 AM GMT) on Tuesday, 16 Feb 2010, so that we can replace one of the disks.

[UPDATE Feb 16th 13:34 UTC] The disk was replaced, and web7 is now fully operational again.

-
-

[Done] Scheduled work on Web99 on Wednesday

Posted in Downtime by

We will be investigating the cause of visual alarms on web99.webfaction.com on Feb 10th, 2010 at 10am GMT.

Depending on the severity we might have to take the server down and if so it will be down between a few minutes and a few hours. We will update this ticket as soon as we have more information on Wednesday.

[Feb 10th, 11:45 GMT] Web99 is up and running again. No further service interruptions are expected.

-
-

[Fixed] Web84 through Web122 down

Posted in Downtime by

Web84 through Web122 are currently down. We are investigating the issue at this time and will post an update shortly.

[UPDATE 2010-02-07 16:54 UTC] Web84 through Web122 are back online. The cause of the problem is still under investigation.

[UPDATE 2010-02-08 15:05 UTC] The outage was caused due to a failure of a network router in the data center.

-
-

[Fixed] Web113 under DDoS attack

Posted in Downtime by

Web113 is under a Distributed Denial of Service attack, which is causing occasional delays and timeouts for all sites hosted there. We are working to rectify the effect of the attack.

No other servers are affected.

Update [4:42 GMT]: What we believed to be a DDoS attacked turned out to be an excessive mount of traffic directed at some extremely large page hosted on the server. We have now taken measures to reduce the impact of this traffic, and the server is back to normal.

-
-