Web4 down [fixed]

Posted in Downtime by

Web4 stopped responding several minutes ago, and is currently being rebooted.

Update [06:16 AM CDT]: Web4 is now fully functional again.

-
-

Web3 down [fixed]

Posted in Downtime by

Web3 stopped responding several minutes ago and is currently being rebooted. We should have service restored soon.

Update [1:59:22 PM CDT]: The server is back online we are investigating the cause.

Update [2:29:11 PM CDT]: This appears to have been due to high load. We’ll monitor the server closely for the next couple of hours.

-
-

[Done] Scheduled down time on all web servers.

Posted in Scheduled downtime by

http://statusblog.webfaction.com/scheduled-down-time-on-all-web-servers-ii is done. We did not end up having to reboot Web 2 through Web 20 or Dweb 1 through Dweb 18.

-
-

[Resolved] Web 85 Down

Posted in Downtime by

As a part of http://statusblog.webfaction.com/scheduled-down-time-on-all-web-servers-ii Web 85 was scheduled to be down for 10 minutes, it has been down for 45 minutes. Service will be restored ASAP.

Update [01:45 PM CDT]: Service has been restored. Web 85 was not down, it was inaccessible due to a loose network cable.

-
-

Reminder: Scheduled down time on all web servers tomorrow.

Posted in Scheduled downtime by

See http://statusblog.webfaction.com/scheduled-down-time-on-all-web-servers-ii for more details.

-
-

[Fixed] Web17 down

Posted in Downtime by

Web17 stopped responding several minutes ago and is currently being rebooter. We should have service restored soon.

2009-08-27 11:12 – Web17 is back online. The problem appears to have been extremely high load due to a massive number of incoming FTP connections.

-
-

[Done] Scheduled downtime on Web61

Posted in Scheduled downtime by

At 6pm GMT today we will take down Web61 to check the filesystem with fsck. We will update this post with our progress.

Update 1.10pm CDT time: fsck has now started

Update 3pm CDT time: the fsck run is now over and the server is back online

-
-

[Fixed] Web61 down

Posted in Downtime by

The filesystem on Web61 went into a read-only state at around 19:30 CDT. We rebooted the machine at that time and it has not yet come back online.

We’re working with the data center team to resolve this issue and hope to have service restored soon. We’ll update this post when we have more info.

2009-08-15 20:46 CDT – web61 is back online, but the filesystem problem remains. We are still investigating the problem.

2009-08-16 04:26 CDT – web61 is now back online and working. We will schedule a fsck run for later in the day.

-
-

Web8 down [fixed]

Posted in Downtime by

The filesystem on Web8 went into a read-only state several minutes ago. We rebooted the server, and it is currently running a filesystem check. We hope to have service restored soon.

-
-

Mail2script missing some emails

Posted in Problems by

We are currently experiencing an issue with our “mail2script” feature (see http://blog.webfaction.com/mail2script) which is causing it to miss a small percentage of emails.

We will update this post as soon as we have a resolution.

-
-