Scheduled maintenance on Sunday, July 2, 2017

Posted in Uncategorized by

We will be performing power maintenance on the following servers between 21:00 UTC July 2, 2017 and 00:00 UTC July 3, 2017:

wf-207-38-86-39
wf-207-38-86-40
wf-207-38-86-43
wf-207-38-86-47
wf-207-38-86-48
wf-207-38-86-49
wf-207-38-86-73
wf-207-38-86-75
wf-207-38-86-76
wf-207-38-86-78
wf-207-38-86-79
wf-207-38-86-85
wf-207-38-86-88
wf-207-38-86-90
wf-207-38-86-92
wf-207-38-86-93
wf-207-38-86-94
wf-207-38-86-98
wf-207-38-86-102
wf-207-38-86-103
wf-207-38-86-104
wf-207-38-86-105
wf-207-38-86-106
wf-207-38-86-107
wf-207-38-92-110
wf-207-38-86-178
wf-207-38-86-180
wf-207-38-86-191
wf-207-38-86-193
wf-207-38-86-194
wf-207-38-86-195
wf-207-38-86-196
wf-207-38-86-197
wf-207-38-86-198
wf-207-38-86-199
wf-207-38-93-249
wf-207-38-86-77
wf-207-38-86-135
wf-207-38-86-138
wf-207-38-86-140
wf-207-38-86-145
wf-207-38-86-147
wf-207-38-86-149
wf-207-38-86-150
wf-207-38-86-159
wf-207-38-86-160
wf-207-38-86-164
wf-207-38-86-165
wf-207-38-86-166
wf-207-38-86-167
wf-207-38-86-168
wf-207-38-86-170
wf-207-38-86-171
wf-207-38-86-175
web590
web591
web592
web593
web594
web595
web596
web597
web598
web600
web601
web602
web603

Connectivity to the servers will be interrupted for up to one hour during the maintenance window. We apologize in advance for the inconvenience. Should you have any questions about this maintenance, feel free to open a support ticket and our support team will be happy to help.

 

-
-

[Fixed] Web416 inaccessible

Posted in Downtime by

2017-06-27 13:10 UTC: The server is currently not responding. We are investigating the issue and will update this post as soon as we have further details.

2017-06-27 13:24 UTC: The server is back online.

-
-

[fixed] web530 and web561 offline

Posted in Downtime by

We are currently investigating the issue and will update as soon as we have further details.

2017-06-22 19:06 UTC: The servers are accessible again. There was a network issue that caused the temporary interruption.

-
-

[fixed] Partial incoming mail service disruption

Posted in Problems by

2017-06-20 20:44 UTC: A networking issue in one of our US data centers is affecting incoming mail service and webmail logins for some customers. We’re working to restore service and will update this post when more information is available.

2017-06-20 20:59 UTC: Service has been restored – we’ll continue to monitor.

2017-06-21 14:36 UTC: There have been no further disruptions, and the data center confirms that the networking issue is resolved.

-
-

[fixed] Web576 offline

Posted in Downtime by

2017-06-20 01:41 UTC: Web576 is currently offline due to a DDoS attack. We’re working to restore service and will update this post when more information is available.

2017-06-20 02:09 UTC: We’ve mitigated the attack upstream. The server appears to be stable, but the mitigation may affect UDP traffic. Please contact WebFaction support if you’re not able to access the server. We’ll continue to monitor.

2017-06-20 14:33 UTC: At the present time, Web576 is showing very high packet loss. We’re investigating at this time.

2017-06-20 17:48 UTC: Web576 is stable at this time. We’ll continue to monitor.

2017-06-21 14:37 UTC:  The attack has resumed, and we’re working to mitigate it.

2017-06-21 18:21 UTC: We’ve possibly identified the intended target of the attack and have isolated them from other customers. The server is stable at this time and we’ll continue to monitor.

2017-06-22 18:23 UTC: The server has been stable for the past 24 hours. We’ll continue to monitor.

2017-06-25 15:23 UTC: The server has been stable for over 72 hours, and there has been no further sign of any attack.

-
-

[Done] Scheduled maintenance on Sunday, June 25, 2017

Posted in Uncategorized by

We will be performing power maintenance on the following servers between 16:00 UTC June 25, 2017 and 04:00 UTC June 26, 2017:

wf-207-38-86-39
wf-207-38-86-40
wf-207-38-86-43
wf-207-38-86-47
wf-207-38-86-48
wf-207-38-86-49
wf-207-38-86-73
wf-207-38-86-75
wf-207-38-86-76
wf-207-38-86-78
wf-207-38-86-79
wf-207-38-86-85
wf-207-38-86-88
wf-207-38-86-90
wf-207-38-86-92
wf-207-38-86-93
wf-207-38-86-94
wf-207-38-86-98
wf-207-38-86-102
wf-207-38-86-103
wf-207-38-86-104
wf-207-38-86-105
wf-207-38-86-106
wf-207-38-86-107
wf-207-38-92-110
wf-207-38-86-178
wf-207-38-86-180
wf-207-38-86-191
wf-207-38-86-193
wf-207-38-86-194
wf-207-38-86-195
wf-207-38-86-196
wf-207-38-86-197
wf-207-38-86-198
wf-207-38-86-199
wf-207-38-93-249
wf-207-38-86-77
wf-207-38-86-135
wf-207-38-86-138
wf-207-38-86-140
wf-207-38-86-145
wf-207-38-86-147
wf-207-38-86-149
wf-207-38-86-150
wf-207-38-86-159
wf-207-38-86-160
wf-207-38-86-164
wf-207-38-86-165
wf-207-38-86-166
wf-207-38-86-167
wf-207-38-86-168
wf-207-38-86-170
wf-207-38-86-171
wf-207-38-86-175
web590
web591
web592
web593
web594
web595
web596
web597
web598
web600
web601
web602
web603

Connectivity to the servers will be interrupted for up to one hour during the maintenance window. We apologize in advance for the inconvenience. Should you have any questions about this maintenance, feel free to open a support ticket and our support team will be happy to help.

 

2017-06-25 22:26 UTC: The maintenance has begun.

2017-06-25 23:48 UTC: The maintenance had to be postponed.

-
-

[Rescheduled] Scheduled maintenance on Sunday, June 18, 2017

Posted in Downtime by

We will be performing a power maintenance on the following servers at 16:00 UTC June 18, 2017 between and 4:00 UTC June 19, 2017:

wf-207-38-86-39
wf-207-38-86-40
wf-207-38-86-43
wf-207-38-86-47
wf-207-38-86-48
wf-207-38-86-49
wf-207-38-86-73
wf-207-38-86-75
wf-207-38-86-76
wf-207-38-86-78
wf-207-38-86-79
wf-207-38-86-85
wf-207-38-86-88
wf-207-38-86-90
wf-207-38-86-92
wf-207-38-86-93
wf-207-38-86-94
wf-207-38-86-98
wf-207-38-86-102
wf-207-38-86-103
wf-207-38-86-104
wf-207-38-86-105
wf-207-38-86-106
wf-207-38-86-107
wf-207-38-92-110
wf-207-38-86-178
wf-207-38-86-180
wf-207-38-86-191
wf-207-38-86-193
wf-207-38-86-194
wf-207-38-86-195
wf-207-38-86-196
wf-207-38-86-197
wf-207-38-86-198
wf-207-38-86-199
wf-207-38-93-249
wf-207-38-86-77
wf-207-38-86-135
wf-207-38-86-138
wf-207-38-86-140
wf-207-38-86-145
wf-207-38-86-147
wf-207-38-86-149
wf-207-38-86-150
wf-207-38-86-159
wf-207-38-86-160
wf-207-38-86-164
wf-207-38-86-165
wf-207-38-86-166
wf-207-38-86-167
wf-207-38-86-168
wf-207-38-86-170
wf-207-38-86-171
wf-207-38-86-175
web590
web591
web592
web593
web594
web595
web596
web597
web598
web600
web601
web602
web603

Connectivity to the servers will be interrupted for up to one hour during the maintenance window. We apologize in advance for the inconvenience. Should you have any questions about this maintenance, feel free to open a support ticket and our support team will be happy to help.

2017-06-19 16:20 UTC:  The maintenance had to be rescheduled and we’ll post the new schedule when it is ready.

2017-06-19 22:47 UTC: Rescheduled to Sunday, June 25, 2017

-
-

[Monitoring] Control panel, API, and website down

Posted in Downtime by

2017-06-05 19:36 UTC: our control panel server is currently not responding. This also affects the control panel API and www.webfaction.com. We’re working to restore service and will update this post when more info is available.

2017-06-05 19:47 UTC: the panel, API, and www.webfaction.com are back online. We’re monitoring for further issues.

-
-

[Done] Scheduled maintenance on mailing list servers Saturday 10th June

Posted in Uncategorized by

Between 07:00 UTC and 11:00 UTC we will be performing maintenance on our mailing list servers. During this time list archives and administration will be unavailable and any incoming mail will be delayed until after the maintenance is complete.

07:00 UTC: The maintenance has begun

08:20 UTC: Maintenance has been completed. Mailing lists are back online

-
-

[fixed] MySQL down on Web231

Posted in Problems by

2017-05-26 00:59 UTC: MySQL on Web231 is currently down. We’re working to restore service and will update this post when more info is available.

2017-05-26 01:13 UTC: We’re dumping and reloading all MySQL databases on Web231. The reload is halfway complete.

2017-05-26 01:25 UTC: All MySQL databases on Web231 have been restored and the MySQL service is now operational.

-
-