Traffic from countries under US embargo blocked on some of our servers from Feb 1st

Posted in Downtime by

WebFaction hosts servers in a number of data-centres all around the world, including in the U.S, Europe and Asia. Several of those data-centres are owned by a US company called SoftLayer.

Starting on the February 1st, 2016. SoftLayer will implement a network-wide blocking of IP addresses that originate from countries that are subject to U.S. trade and economic sanctions. Currently, these countries are Cuba, Iran, North Korea, Sudan, and Syria. This means that Internet users in those countries will not be able to access websites hosted in the SoftLayer data-centres.

If it is important that your websites can be accessed from any of those countries, please let us know. We can tell you if your data-centre is one which is impacted by this block and help migrate your website to a different data-centre.

-
-

[Done] CentOS 7 reboots to patch the CVE-2016-0728 vulnerability

Posted in Scheduled downtime by

In the next few hours we are going to reboot all of our CentOS 7 servers to patch them against the CVE-2016-0728 vulnerability.

-
-

[Fixed] Emergency maintenance on Web518

Posted in Downtime by

Web518 is being taken down for emergency disk maintenance. We will update this post as maintenance progresses.
2016-01-18 18:34 UTC: Web518 is back online.
2016-01-18 22:40 UTC: We are taking the machine down again to replace the RAID card.
2016-01-18 23:01 UTC: Web518 is back online.

-
-

Outbound email on port 25 blocked from Feb 1st

Posted in Service change by

From February 1st, 2016 our web servers will start blocking all outbound email traffic to port 25 on third party servers. Port 25 traffic will only be allowed to our outbound email server – smtp.webfaction.com.

This change is being made in order to help combat junk mail and improve the reliability of our email system for genuine email traffic.

Most people will not see any disruption from this change. The only thing being blocked are emails sent from our web servers which bypass our email system and directly connect to third party SMTP servers on port 25. Specifically there will be no disruption to:

  • Our normal email system. There will be no change to how you interact with your email via Outlook, Apple mail, webmail or any other email client from home or work.
  • Email sent from your website or applications via an SMTP connection to smtp.webfaction.com
  • Email sent from your website or applications via a local delivery agent such as /usr/sbin/sendmail, /bin/mail or similar.
  • Email sent from your website via a third party SMTP server on ports 465 or 587.
  • Most email sent via web-apps and frameworks like WordPress, Django, Rails, etc. The default configuration for these tools use our email system and will continue to work. However, we do recommend that you check your configuration.

If you do send email from our web servers directly to third party SMTP servers then from February 1st you will have three options:

  • Switch to using a local delivery agent – /usr/sbin/sendmail or /bin/mail
  • Switch to using our SMTP server – smtp.webfaction.com
  • Continue to use the 3rd party SMTP server, in which case you will have to use port 465 for SMTP/SSL or 587 for SMTP/TLS because port 25 will be blocked.

If you have any questions about this change don’t hesitate to open a support ticket or email support@webfaction.com and our support team will be happy to help.

-
-

Web503 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue.

2016-01-18 15:20 UTC: The server is under a heavy DDoS attack. We are working with our upstream provider to restore the network connectivity ASAP.

2016-01-18 16:47 UTC: The attack is ongoing. The mitigation system has restored SSH connectivity, but HTTP connectivity is still severely impacted. We’ll update this post as soon as we have more information.

2016-01-18 17:17 UTC: HTTP connectivity has been restored, although some sites might still be slower due to ongoing DDOS mitigation. We’ll update this post as soon as we have more information.

-
-

[Fixed] Web474 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue.

2016-01-17 15:25 UTC: The server is back online.

-
-

[Done] Scheduled maintenance for mx7 on Saturday, January 16th 2016

Posted in Downtime by

On Saturday, January 16th 2016 between 08:00 UTC and 12:00 UTC one of our incoming mail servers – MX7 – will be brought down for a hardware upgrade. Expected downtime is between one and two hours.

There should be no disruption to mail services during this time.

13:00 UTC The maintenance is complete and the machine is back online.

-
-

[Fixed] MySQL down on Web416

Posted in Downtime by

The shared MySQL database service on Web416 is currently down. We’re working to restore service at this time. We’ll update this post when more information is available.

2016-01-14 04:16 UTC: All databases have been restored and MySQL is back online. If you have any problems, please open a support ticket.

2016-01-14 08:20 UTC: Some MySQL databases were not properly restored. We are now working on fixing this issue as soon as possible.

2016-01-14 11:45 UTC: All databases have been restored. If you are still seeing any issues, please open a support ticket.

-
-

[Fixed] web162 inaccessible

Posted in Downtime by

We are investigating why the server is not accessible. We will update as soon as we have more information.

2016-01-06 04:09 UTC: Apologies for the delays, we’re working with our datacenter to remedy the situation as soon as possible.

2016-01-06 13:53 UTC: Due to a hardware failure we are in the process of replacing the server. We will update this post as the work progresses.

2016-01-06 17:58 UTC: The hardware has been replaced and the server is back online.

-
-

[Fixed] Web514 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue.

2016-01-04 17:04 UTC: The machine is back online after replacing a faulty RAID card.

2016-01-04 17:33 UTC: Server is not responding again. Investigating.

2016-01-04 18:46 UTC: We’re doing a complete chassis swap for Web514.

2016-01-04 20:07 UTC: Chassis swap is done, we’re rebuilding the server RAID.

2016-01-04 21:09 UTC: RAID rebuild is completed. We’re working on reconfiguring network.

2016-01-04 23:46 UTC: The server is up and running again.

-
-