[Fixed] Issues with Web404

Posted in Downtime by

We’re currently experiencing issues with the server’s operation and are looking into it.

We’ll keep you updated as we find out more.

Thanks for your patience!

2014-12-18 02:53:34 (UTC ): The server is functioning, please submit a ticket if you’re still having issues

-
-

[Fixed] Emergency maintenance on Web441

Posted in Downtime by

An issue is preventing the machine from booting. We are working to restore service as soon as possible.  We will post updates as we have them.

Update: The issue occurred during a kernel upgrade on the server and it is now fixed.

-
-

[Fixed] Web347, Web247, Web345 offline

Posted in Downtime by

Web347. Web247, Web345 are currently offline. We’re working to restore service at this time and will update this post as soon as we have more information.

2014-06-14 06:18 UTC: Services have been restored, we are looking as to how  this happened. Apologies for any inconveniences.

-
-

[Resolved] DDoS attack on web451

Posted in Downtime by

The server is currently under a heavy DDoS attack. Mitigation has been enabled to help with the issue. We will continue to monitor and will update when we have more information.

2014-06-08 02:48 UTC: The DDoS attack has stopped.

2014-06-09 08:03 UTC: The DDoS attack has begun again.

2014-06-10 08:38 UTC: We are working with our datacenter to restore service, and confirm traffic mitigation while we locate the source.

2014-06-10 09:09 UTC: Service has been restored with traffic mitigation in place, we’re in the process of attempting to locate the source of the attack.

2014-06-10 14:30 UTC: The DDoS attack has started again. The server has been placed behind our DDoS mitigation system, but it’s still having connectivity issues due to the massive scale of the attack. We are doing our best to restore service as soon as possible.

2014-06-10 22:03 UTC: The DDoS attack has stopped, and the server has returned to normal.

2014-06-11 8:20 UTC: The DDoS attack started again. DDoS mitigation has been enabled. Our system administrators are doing their best to restore serviceASAP.

2014-06-11 9:20 UTC: Service has been restored with traffic mitigation in place.

2014-06-11 18:10 UTC: The server is still behind our DDoS mitigation system, but it’s still having connectivity issues due to the massive scale of the attack. We are doing our best to restore service as soon as possible.

2014-06-11 22:20 UTC: The DDoS attack has stopped, and the server has returned to normal.

2014-06-12 8:20 UTC: The DDoS attack has started again. We are working to restore service as soon as possible.

2014-06-12 17:19 UTC: Due to the size of the attack, we have split the domains on the machine over several proxy servers to get the sites back online. If you experience any issues with your sites open a ticket and we’ll look into it asap.

2014-06-13 01:40 UTC: The DDoS attack has subsided at this time. The proxy arrangement will remain in place for now. We’ll update this post when we have more information.

2014-06-16 15:46 UTC: The DDoS attack has started again. We are working isolating the specific target.

2014-06-26 17:53 UTC: We have isolated the target to a separate server and customers on web451 should no longer be affected.

2014-06-26 19:22 UTC: The DDoS attack has started again. We are working isolating the specific target.

2014-06-26 21:43 UTC: Due to the size of the attack, we have split the domains on the machine over several proxy servers to get the sites back online. Note the if you are not using WebFaction for DNS you will need to change your settings at your DNS provider. If you experience any issues with your sites open a ticket and we’ll look into it asap.

2014-06-27 20:07 UTC: The DDoS attack has stopped and the null route removed. We are leaving the proxies in place for now.

2014-06-28 16:18 UTC: The DDoS attack has resumed and the server has been placed under mitigation.

2014-06-30 20:56 UTC: The DDoS attack has subsided at this time.

-
-

[Update] Issue with MySQL on Web210

Posted in Downtime by

The MySQL service on web210 is currently intermittent. We’re working to restore service and will update this post when we have more information.

2014-05-22 19:46 UTC: Server is currently online and all services are running.

2014-05-23 20:19 UTC: Due to the continuing issues, we’ve scheduled a migration: http://statusblog.webfaction.com/2014/05/22/migration-of-web210-to-faster-hardware-on-may-26th-ip-address-change/

-
-

[Fixed] Network issues on web57

Posted in Downtime by

Web57 is experiencing some network routing issues, which greatly affects its network connectivity. Packet loss and other network problems are to be expected.

We are working with our datacenter on resolving the problem and we will update this post as soon as we have more information on the subject.

0443 UTC Service has been restored and websites are once again serving traffic. Please let support know via a ticket if you are still seeing a problem.

-
-

[Fixed] DWeb 103 inaccessible

Posted in Downtime by

Currently DWeb103 is not accessible and not responding to network requests. We are investigating the issue and working to bring all services back online ASAP.

1828 UTC The server was rebooted via the engineers at the Datacenter and full service has been restored. No further issues are anticipated.

-
-