[Fixed] Widespread network issues

Posted in Downtime by

We are currently seeing widespread connectivity issues across our hosting platform, and this is affecting both webserver-to-webserver communication as well as external website accessibility for hosted sites. We’re working on restoring normal network functionality as quickly as possible.

Update Thu Apr 19 07:20 UTC 2018: At this point we believe that we’ve fixed all network issues and that full service has been restored. If you’re still seeing network problems at this time, please let our Support team know.

Update Thu Apr 19 10:11 UTC 2018: We haven’t received any more reports of issues and everything looks good, so we’re marking this Fixed.

-
-

[Fixed] Several US servers inaccessible

Posted in Downtime by

We’ve just got an alert about the following US based servers being inaccessible.

We’re investigating at this time and will update this post when more information is available.

The affected shared servers are: web500, web501, web518, web521, web524, web590, web591, web592, web594, web595, web596, web597, web598, web599, web600, web601, web602, web603, web608, web609, web610, web611, web612, web613, web614, web615, web616, web617, web618, web619, web620, web621, web622, web623, web624, web625, web626, web627, web628, web629, web630, web631, web632, web634.

The affected cloud instances are: wf-148-72-160-10, wf-148-72-160-103, wf-148-72-160-104, wf-148-72-160-105, wf-148-72-160-106, wf-148-72-160-107, wf-148-72-160-108, wf-148-72-160-109, wf-148-72-160-110, wf-148-72-160-111, wf-148-72-160-114, wf-148-72-160-115, wf-148-72-160-117, wf-148-72-160-118, wf-148-72-160-119, wf-148-72-160-12, wf-148-72-160-120, wf-148-72-160-13, wf-148-72-160-14, wf-148-72-160-16, wf-148-72-160-17, wf-148-72-160-5, wf-148-72-160-6, wf-148-72-160-7, wf-148-72-160-8, wf-148-72-160-9, wf-207-38-86-102, wf-207-38-86-125, wf-207-38-86-135, wf-207-38-86-138, wf-207-38-86-140, wf-207-38-86-145, wf-207-38-86-147, wf-207-38-86-149, wf-207-38-86-150, wf-207-38-86-159, wf-207-38-86-160, wf-207-38-86-164, wf-207-38-86-165, wf-207-38-86-166, wf-207-38-86-167, wf-207-38-86-168, wf-207-38-86-170, wf-207-38-86-171, wf-207-38-86-175, wf-207-38-86-187, wf-207-38-86-192, wf-207-38-86-194, wf-207-38-86-67, wf-207-38-86-68, wf-207-38-86-77, wf-207-38-92-106, wf-207-38-92-115, wf-207-38-92-122, wf-207-38-92-123, wf-207-38-92-124, wf-207-38-92-125, wf-207-38-92-135, wf-207-38-92-14, wf-207-38-92-144, wf-207-38-92-149, wf-207-38-92-176, wf-207-38-92-18, wf-207-38-92-182, wf-207-38-92-183, wf-207-38-92-184, wf-207-38-92-215, wf-207-38-92-244, wf-207-38-92-5, wf-207-38-92-55, wf-207-38-92-6, wf-207-38-92-61, wf-207-38-92-7, wf-207-38-92-93, wf-207-38-92-94, wf-207-38-92-95, wf-207-38-93-134, wf-207-38-93-174, wf-207-38-93-187, wf-207-38-93-216, wf-207-38-93-252, wf-207-38-93-253, wf-207-38-93-254, wf-207-38-93-35, wf-207-38-93-36, wf-207-38-93-93, wf-207-38-94-108, wf-207-38-94-111, wf-207-38-94-140, wf-207-38-94-159, wf-207-38-94-181, wf-207-38-94-206, wf-207-38-94-21, wf-207-38-94-22, wf-207-38-94-224, wf-207-38-94-230, wf-207-38-94-235, wf-207-38-94-241, wf-207-38-94-251, wf-207-38-94-69, wf-207-38-94-70, wf-207-38-94-78, wf-207-38-94-91

2018-03-03 16:19 UTC We’ve identified the cause as a power outage. Servers are beginning to come back online now. We’ll update this post if anything changes.

2018-03-03 17:14 UTC The power outage was caused by a cooling failure. This is being worked on now. We’ll update this post when more information becomes available.

2018-03-03 18:50 UTC The issue is resolved and all servers have been restarted. We’ll continue to monitor. If you see any issues, please open a support ticket.

-
-

[Fixed] Web530 inaccessible

Posted in Downtime by

Web530 is currently not accessible. We are working to restore services as soon as possible.

2018-02-07 16:51 UTC: We are still working with our data center to bring the machine back online as soon as possible.

2018-02-07 20:04 UTC: The servers is back online.

2018-02-08 07:39 UTC: The server is experiencing network issues again and is inaccessible. We’re looking into this issue and will update this post as soon as we have more info.

2018-02-08 10:12 UTC: The server is up and running and looks stable. We’ll be monitoring it for a while before marking this issue as resolved. Please let us know if you notice any further issues from your end.

2018-02-08 10:49 UTC: Some customers have reported issues accessing the server via IPv4. We are looking into this. Customers using IPv6 should be able to access the server.

2018-02-08 14:30 UTC: After monitoring the server for some time, all services look stable so we’ll mark this issue as fixed.

-
-

[fixed] Web571 inaccessible

Posted in Downtime by

Web571 is currently not accessible. We are looking into the issue and will resolve as quickly as possible.

2018-01-07 08:45 UTC: The issue has been resolved with a reboot and the server should be responding to requests.

-
-

[Fixed] Web623 inaccessible

Posted in Downtime by

Web623 didn’t came back after our recent reboot to patch the ‘Meltdown’ and ‘Spectre’ security vulnerabilites.

We are working with our datacenter technicians to resolve this issue and get the server up and running again as quickly as possible.

2018-01-06 07:30 UTC: The server is back online.

-
-

[fixed] web544 inaccessible

Posted in Downtime by

The server is currently not accessible. We are looking into the issue and will resolve as quickly as possible.

2017-12-27 13:36 UTC: The issue has been resolved with a reboot and the server is back online.

-
-

[Fixed] Several cloud servers offline

Posted in Downtime by

2017-10-06 17:13 UTC: Several of our cloud servers are currently offline due to an unknown issue. We’re investigating at this time and will update this post when more information is available. The affected servers are:

  • wf-173-255-197-72
  • wf-173-255-203-84
  • wf-198-58-100-37
  • wf-198-58-120-80
  • wf-198-58-98-119
  • wf-207-38-86-187
  • wf-207-38-86-192
  • wf-207-38-92-115
  • wf-207-38-92-14
  • wf-207-38-92-176
  • wf-207-38-92-182
  • wf-207-38-92-183
  • wf-207-38-92-184
  • wf-207-38-92-215
  • wf-207-38-92-244
  • wf-207-38-92-55
  • wf-207-38-92-93
  • wf-207-38-92-94
  • wf-207-38-93-134
  • wf-207-38-93-174
  • wf-207-38-93-187
  • wf-207-38-93-252
  • wf-207-38-93-253
  • wf-207-38-93-254
  • wf-207-38-94-111
  • wf-207-38-94-206
  • wf-207-38-94-230
  • wf-207-38-94-235
  • wf-207-38-94-251
  • wf-23-239-25-54
  • wf-45-33-113-161
  • wf-45-33-14-240
  • wf-45-33-18-166
  • wf-45-33-24-216
  • wf-45-33-7-73
  • wf-45-56-122-41
  • wf-45-56-123-50
  • wf-45-56-77-37
  • wf-45-79-0-162
  • wf-45-79-1-12
  • wf-45-79-10-158
  • wf-45-79-4-136
  • wf-45-79-7-111
  • wf-66-228-50-12
  • wf-72-14-182-215
  • wf-96-126-117-174

2017-10-06 17:32 UTC: Several cloud servers are back online after a reboot of the host hardware. The servers down at this time are:

  • wf-173-255-197-72
  • wf-173-255-203-84
  • wf-198-58-100-37
  • wf-198-58-120-80
  • wf-198-58-98-119
  • wf-23-239-25-54
  • wf-45-33-113-161
  • wf-45-33-14-240
  • wf-45-33-18-166
  • wf-45-33-24-216
  • wf-45-33-7-73
  • wf-45-56-122-41
  • wf-45-56-123-50
  • wf-45-56-77-37
  • wf-45-79-0-162
  • wf-45-79-1-12
  • wf-45-79-10-158
  • wf-45-79-4-136
  • wf-45-79-7-111
  • wf-66-228-50-12
  • wf-72-14-182-215
  • wf-96-126-117-174

2017-10-06 18:32 UTC: All of the affected servers are back online.

2017-10-11 12:59 UTC: We are taking the machine down for emergency maintenance to do a chassis swap.

2017-10-11 15:48 UTC: The server is back online.

-
-

[fixed] web607 inaccessible

Posted in Downtime by

The server is currently not responding. We are investigating the issue and will post updates as soon as we have further details.

2017-09-07 18:35 UTC: There is an issue with the RAID controller. We are working to have this resolved as quickly as possible.

2017-09-07 19:15 UTC: The server is currently back online. However, we are still investigating the issue further.

2017-09-07 20:57 UTC: There have been no further issues since the server reboot.

-
-

[fixed] web527 inaccessible

Posted in Downtime by

Web527 did not come back after a reboot. We are looking into this and will resolve as quickly as possible.

2017-08-15 13:48 UTC: The server is back online. The issue was with the installed kernel. It was changed and the server rebooted.

-
-

[monintoring] web550 inaccessible

Posted in Downtime by

The server is currently inaccessible. We are investigating the issue and will update as soon as we have more details.

2017-07-12 00:33 UTC: Web550 is back online at this time. The problem appears to have been an DDoS attack targeting Web550. The attack has subsided. We’ll continue to monitor.

2017-07-12 15:32 UTC: Web550 was rebooted 90 minutes ago to attempt to resolve an issue with IPv6 connectivity. The server is back online, but IPv6 connectivity is down.

-
-