[Fixed] Web162 inaccessible

Posted in Uncategorized by

The server is currently not responding. We are investigating the issue and will update as soon as we have further details.

2016-09-07 12:51 UTC: There was a temporary network issue that caused this. The server is back online.

2016-09-10 18:45 UTC: The server is currently not responding. We are investigating the issue and will update as soon as we have further details.

2016-09-10 19:15 The server is back online. We are monitoring.

-
-

[Fixed] Web474 inaccessible

Posted in Uncategorized by

We are currently investigating the issue and will post an update as soon as we have further details.

2016-09-04 00:46 UTC: The issue has been resolved and the server is back online now.

-
-

[Done] Scheduled maintenance on web373, September 3, 2016

Posted in Uncategorized by

Web373 will be taken down for RAID maintenance on September 3rd, between 14:00 and 17:00 UTC.

We will update this post as maintenance will progress.

14:20 UTC: The maintenance has begun

14:50 UTC: The maintenance is complete and the server is back online

-
-

[Fixed] Web530 Inaccessible

Posted in Uncategorized by

We are currently looking into the issue and will resolve it as quickly as possible.

2016-07-20 01:32 UTC: The server is back online.

-
-

[Fixed] Web366 unreachable

Posted in Uncategorized by

web366.webfaction.com is unreachable by the external network, and initial evidence suggests possible router failure. Our system administrators are looking into it.

[2016-05-23] The router issue has been addressed and the server is back online.

-
-

[Fixed] Web512 MySQL Maintenance

Posted in Uncategorized by

The shared MySQL databases on Web512 are showing some signs of corruption.  We are rebooting the server into a Rescue environment, checking the filesystem, and will perform a MySQL recovery.

We will update this post as more information becomes available.

2016-04-13 @ 05:50 UTC : The filesystem check is complete.  We are starting the MySQL recovery process.

2016-04-13 @ 09:10 UTC : The recovery is complete.  If you experience any problems with your website, please open a support ticket.

-
-

[Fixed] Web404 DDoS

Posted in Uncategorized by

We are currently experiencing a DDoS attack on web404. Our upstream provider has enabled mitigation for this attack.

There are still some intermittent access issues until the attack subsides further.

We will update this post as soon as we have further information.

2016-04-02 04:53 UTC: Cisco Guard is still enabled to help reduce the impact. We are continuing to monitor.

2016-04-02 12:20 UTC: The attack was overwhelming our upstream provider’s DDoS mitigation system, so they were forced to null-route the server’s IP address. We’re working with them to restore service as soon as possible.

2016-04-02 13:00 UTC: The DDoS attack has subsided and the null route has been removed. We are continuing to monitor.

2016-04-02 23:35 UTC: The DDoS attack has resumed and the server IP has been null-routed again. Apologies for the troubles while we work to restore the server.

2016-04-03 02:03 UTC: The null-route on the server IP has been removed. The server is accessible with mitigation services enabled to help prevent further downtime. This however can cause intermittent access for some while the DDoS is in effect. We’ll continue to monitor the server. Thank you for your patience.

2016-04-04 17:07 UTC: Web404 has been stable for over 24 hours.

2016-04-04 18:10 UTC: The attack has resumed and Web404 has been null-routed again. We’re working to restore service at this time.

2016-04-04 18:47 UTC: The attack as subsided and the null-route has been lifted.

-
-

[Fixed] Web524 Emergency RAID Maintenance

Posted in Uncategorized by

Web524 is being taken down to check the RAID controller. Please stand by for updates.

2016-03-24 21:24 UTC: Web524 is back online.

-
-

[Fixed] Power issue affecting several cloud servers

Posted in Uncategorized by

A power issue in one of our data centers has interrupted service for several cloud servers.

At this time, the machines that we know to be affected are:

  • Wf-23-239-25-54
  • Wf-45-33-116-185
  • Wf-45-33-116-79
  • Wf-45-33-122-20
  • Wf-45-33-123-146
  • Wf-45-33-9-233
  • Wf-45-33-9-39
  • Wf-45-56-121-184
  • Wf-45-56-64-113
  • Wf-45-56-67-11
  • Wf-45-79-11-115
  • Wf-45-79-2-226
  • Wf-45-79-7-111
  • Wf-69-164-192-55
  • Wf-69-164-196-203
  • Wf-104-237-131-190
  • Wf-104-237-138-245
  • Wf-198-58-114-134

The data center team is working to restore service at this time. We’ll update this post when more information is available.

2016-03-15 18:16 UTC: The following cloud servers are still down at this time:

  • Wf-23-239-25-54
  • Wf-45-33-116-185
  • Wf-45-33-122-20
  • Wf-45-33-123-146
  • Wf-45-33-9-39
  • Wf-45-56-121-184
  • Wf-45-56-67-11
  • Wf-45-79-2-226
  • Wf-104-237-131-190
  • Wf-139-162-130-157

2016-03-15 18:30 UTC: All of the cloud servers are back online with the exception of Wf-139-162-130-157.

2016-03-15 18:31 UTC: All of the cloud servers are back online.

-
-

[Done] Scheduled maintenance on web472, March 24, 2016

Posted in Uncategorized by

Web472 will be taken down for power maintenance on March 24th, between 01:00 and 05:00 UTC.

We will update this post as maintenance will progress.

2016-03-25 01:00 UTC: We are starting the maintenance.

2016-03-25 02:50 UTC: The maintenance is complete and the server is back online.

-
-