Network maintenance on 17 February 2015

Posted in Scheduled downtime by

On Wednesday, February 17th, 12:00-14:00 UTC our upstream provider will be performing essential switch maintenance in the racks that house the following servers:

  • Dweb129
  • Dweb130
  • Dweb135
  • Mailbox8
  • Web24
  • Web25
  • Web227
  • Web229
  • Web342
  • Web343

During this time frame, the above servers will be unreachable for 30 minutes.

We’ll update this post as the maintenance progresses.

-
-

Datacenter switch maintenance

Posted in Uncategorized by

Our upstream provider is performing switch maintenance in the Manassas datacenter on February 23th 2016, 12:00-14:00UTC

The following servers will be unavailable for up to 30 minutes.

dweb149, dweb163, dweb150, dweb151

-
-

[Fixed] MySQL down on Web482

Posted in Downtime by

The shared MySQL service on Web482 is currently down. We’re working to restore service at this time. We’ll update this post when more information is available.

Update 13:40 UTC: MySQL is now back to normal. The problem happened when a faulty disk caused the RAID array to become degraded and a MySQL database became corrupted. We’ve repaired the database and swapped the faulty disk and MySQL is now functioning normally.

-
-

Web472 scheduled power maintenance

Posted in Scheduled downtime by

Our datacenter will be performing power maintenance that will affect web472 on March 25th, 2016 between 02:00 and 06:00 UTC.

The server will be unavailable during this time.

 

-
-

[Done]Scheduled maintenance on webmail.webfaction.com, February 10th, 2016.

Posted in Scheduled downtime by

webmail.webfaction.com will be taken down for upgrade on Wednesday, February 10th 2016 between 08:00 UTC and 12:00 UTC. The maintenance should be less than 2 hours. We will update this post as maintenance progresses.

2016-02-10 08:46 UTC The upgrade has been completed.

-
-

[Fixed] Web506 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue.

2016-02-04 06:51 UTC: Apologies for the delay, we’ve been working directly with the datacenter technicians to determine the cause and work towards restoring service to the server.

2016-02-04 07:01 UTC: Services have been restored to normal capacity, Web506 is online. It experienced a hardware issue related to the upstream network, which has been repaired. Please open a support ticket if there are any unresolved issues and we will look into it right away. Thank you for your patience.

2016-02-04 07:41 UTC: There appears to be some re-occurring network disturbances, so we’re re-opening this issue while we take further steps with the datacenter towards  a resolution. Thank you for your patience.

2016-02-04 10:40 UTC: Our datacenter engineers are still working to resolve the network issue. We will update this post as soon as new information arrives.

2016-02-04 11:40 UTC: The network connectivity has been restored through an alternative network interface.  We are still working to get the primary interface online, but things are stable at the moment.

2016-02-04 13:00 UTC: All issues with the network have been resolved.

2016-02-04 18:01 UTC: Web506 has lost connectivity again. We’re working to restore service and will update this post as soon as more information is available.

2016-02-04 20:11 UTC: Our data center team suspects motherboard failure. We’re scheduling a chassis swap at this time.

2016-02-04 20:27 UTC: We’re taking the server down for a chassis swap at this time.

2016-02-05 00:34 UTC: Apologies for the delays. Our datacenter team ran into some issues re-configuring the network interfaces for the new chassis. They are working to get the server up as quickly as possible.

2016-02-05 02:22 UTC: Public access has been restored, though please stand by for further updates confirming resolution on the situation.

2016-02-05 05:18 UTC: The server has been stable for a couple hours now, we’re marking the issue as resolved but will monitor the situation. If you experience any issues you believe to be unresolved, please open a support ticket and we will look into it right away. Thank you again for your patience.

2016-02-05 06:31 UTC: There has been a detectable outage on the server again, we’re once more in communication with our datacenter. Please stand by for further updates.

2016-02-05 09:44 UTC: Currently, the connectivity has been restored, but our data center engineers are still working to resolve the issue permanently. Please stand by for further updates.

2016-02-05 13:00  UTC: The connectivity has been stable in the past hours. We are still monitoring the server closely and working with the data center team towards a permanent resolution.

2016-02-05 14:00  UTC: The network connectivity issue has been resolved permanently.

-
-

[Fixed] Web489 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue.

2016-02-03 23:27 UTC: Web489 is online, we’re still monitoring the server. Please stand by for further updates.

2016-02-04 01:10 UTC: Web489 has been stable for some time now. Please open a support ticket if there are any other issues.

 

-
-

Data center maintenance

Posted in Scheduled downtime by

Our upstream provider is performing maintenance in their Manassas data center on February 16th between 02:00 and 04:00 UTC.

The following servers will be unavailable for 30 minutes.

web24, web342, web343, web229, mailbox8, dweb129, dweb130, web227, web24, web25, dweb135

 

-
-

Traffic from countries under US embargo blocked on some of our servers from Feb 1st

Posted in Downtime by

WebFaction hosts servers in a number of data-centres all around the world, including in the U.S, Europe and Asia. Several of those data-centres are owned by a US company called SoftLayer.

Starting on the February 1st, 2016. SoftLayer will implement a network-wide blocking of IP addresses that originate from countries that are subject to U.S. trade and economic sanctions. Currently, these countries are Cuba, Iran, North Korea, Sudan, and Syria. This means that Internet users in those countries will not be able to access websites hosted in the SoftLayer data-centres.

If it is important that your websites can be accessed from any of those countries, please let us know. We can tell you if your data-centre is one which is impacted by this block and help migrate your website to a different data-centre.

-
-

[Done] CentOS 7 reboots to patch the CVE-2016-0728 vulnerability

Posted in Scheduled downtime by

In the next few hours we are going to reboot all of our CentOS 7 servers to patch them against the CVE-2016-0728 vulnerability.

-
-