Network issues on Web71 [fixed]

Posted in Problems by

Web71 is currently experiencing network issues. It should still be accessible via HTTP and FTP, but outgoing network connections may result in long delays or timeouts.

We will update this post when the issues have been resolved.

2009-09-24 19:58 CDT – The problem has now been fixed and the server rebooted.

-
-

Scheduled SquirrelMail down time.

Posted in Scheduled downtime by

SquirrelMail has nearly outgrown its server so on Thursday October 1 at noon CDT we are going to move it to a server on which it will have plenty of room to grow. We do not expect the down time to last for more than an hour.

-
-

[Done] Scheduled downtime on web4

Posted in Scheduled downtime by

We will be taking down web4 tomorrow at 9am GMT to add an additional drive.

The downtime should last between a few minutes and one hour.

We’ll update this post once the work is completed.

Update: Web4 is now back online with the new drive.

-
-

Network problems affecting multiple servers [fixed]

Posted in Downtime by

Network problems in the data center are currently causing degraded performance and intermittent outages on multiple servers. We’re looking into the problem and hope to have it resolved soon. We will update this post as the situation develops.

2009-09-17 13:40 CDT – the current problems are due to a widespread resolving DNS failure at the data center.

2009-09-17 14:26 CDT – the DNS issues appear to be resolved.

-
-

[Done] Scheduled downtime on web2

Posted in Scheduled downtime by

We will be taking down web2 tomorrow at 9am GMT to add an additional drive.

The downtime should last between a few minutes and one hour.

We’ll update this post once the work is completed.

Update: The new drive has been added and Web2 is now back online.

-
-

Drive replacement on Mail1 [done]

Posted in Downtime by

Mail1 will be down for approximately 1 hour beginning at 8:00 PM US CDT on Tuesday, 15 Sep 2009, so that we can replace one of the disks.

This will only effect people who are using mail1 as their mail server. During this maintenance period, inbound email will continue be accepted and will be delivered once the disk has been replaced. No email will be lost.

Outbound email will also be accepted but delayed if sent via the SMTP server on mail1.webfaction.com. This delay can be avoided by using smtp.webfaction.com as your SMTP server. If you need to use smtp.webfaction.com during the maintenance period, please take the steps shown
at https://help.webfaction.com/117.

2009-09-16 09:13 CDT – this maintenance has been rescheduled for 8:00 PM US CDT on Tuesday, 16 Sep 2009.

2009-09-16 22:30 CDT – work on mail1 is complete.

-
-

Mail1 problems [fixed]

Posted in Downtime by

The Mail1 server was rebooted after suddenly becoming unresponsive. The server is now back up after the reboot, but some file systems failed to be mounted properly. As a result, some of the mailboxes hosted on Mail1 are currently inaccessible.

We are working on this problem, and it will be fixed as soon as possible.

2009-09-05 11:03 CDT – Mail1 is back online. We’ll continue to investigate the cause of the filesystem problems. If we determine that a drive needs to be replaced, we’ll post a new entry in the status blog in advance.

-
-

Web4 down [fixed]

Posted in Downtime by

Web4 stopped responding several minutes ago, and is currently being rebooted.

Update [06:16 AM CDT]: Web4 is now fully functional again.

-
-

Web3 down [fixed]

Posted in Downtime by

Web3 stopped responding several minutes ago and is currently being rebooted. We should have service restored soon.

Update [1:59:22 PM CDT]: The server is back online we are investigating the cause.

Update [2:29:11 PM CDT]: This appears to have been due to high load. We’ll monitor the server closely for the next couple of hours.

-
-

[Done] Scheduled down time on all web servers.

Posted in Scheduled downtime by

http://statusblog.webfaction.com/scheduled-down-time-on-all-web-servers-ii is done. We did not end up having to reboot Web 2 through Web 20 or Dweb 1 through Dweb 18.

-
-