[monitoring] Web346 offline

Posted in Downtime by

2017-03-16 20:01 UTC: The networking services on Web346 are currently down and the machine is offline. We’re working to restore service at this time and will update this post when more information is available.

2017-03-16 22:06 UTC: Web346 is back online after our upstream network provider reconfigured a switch. We’ll continue to monitor for signs of trouble.

2017-03-16 22:26 UTC: Web346 has gone offline again. We’re working to restore service at this time and will update this post when more information is available.

2017-03-16 23:25 UTC: We’re still investigating the connectivity issue.

2017-03-17 00:24 UTC: We’re still investigating the connectivity issue.

2017-03-17 01:44 UTC: We’ve switched Web346 to a different OS kernel and it seem to be stable now. We’ll continue to monitor.

2017-03-17 15:43 UTC: Several hours ago, we determined that Web346 was being attacked. At that time, we took steps to mitigate the attack, and the server has been stable since then. We’ll continue to monitor.

-
-

[Fixed] Control panel and API

Posted in Problems by

2017-03-10 22:35 UTC: Our control panel and API was under heavy load for the past 10 minutes and may have been slow or unresponsive for some customers. The problem has been resolved and the panel and API are responding normally at this time.

-
-

[Fixed] Datacenter connectivity issue affecting mail system and dedicated servers

Posted in Downtime by

2017-03-02 22:15 UTC: A network connectivity issue in one of our data centers is affecting our incoming mail system. We’re working to restore service and will update this post as soon as more info is available.

2017-03-02 22:47 UTC: This issue is also affecting some of our dedicated servers: DWEB53, DWEB39, DWEB73

2017-03-02 22:52 UTC: Connectivity is now restored. We’ll continue to monitor.

2017-03-03 00:18 UTC: The cause of the issue was a faulty linecard in the data center. The problem has been resolved.

-
-

[Fixed] Web398 offline

Posted in Downtime by

Web398 is offline while we are troubleshooting an issue affecting SSH authentication. We hope to have service restored quickly and will update this post when we have more information.

2017-01-10 00:23 UTC: The issue has been resolved and Web398 is back online.

-
-

[complete] Control panel and API maintenance reboots

Posted in Maintenance by

2016-12-05 17:13 UTC: We will be rebooting our control panel and API services in the next hour to accomplish some maintenance tasks. The services should be down for know more than a few minutes. We’ll update this post when the maintenance is complete.

2016-12-05 18:51 UTC: The maintenance is complete.

-
-

[Fixed] Web315, Web318 offline

Posted in Downtime by

Web315 and Web318 have failed to come back online following a maintenance reboot. We’re looking into the problem at this time and will update this post when we have more information

2016-11-05 00:39 UTC: The issue is still under investigation.

2016-11-05 04:10 UTC: The issue with Web315 has been resolved and the server is back online. We are still working on solving the problem with Web318 as soon as possible.

2016-11-05 15:50 UTC Web318 is back online.

-
-

[monitoring] Intermittent timeouts on multiple servers

Posted in Problems by

For the past 48 hours, we’ve been seeing a series of intermittent “504 Gateway Timeout” errors on multiple servers.

We are actively troubleshooting this issue and will update this post when we have more information.

2016-11-02 14:50 UTC: We have deployed a fix on the affected machines, and we are monitoring the servers closely. Please contact us if you still see such issues.

-
-

[monitoring] Intermittent connectivity for Web319

Posted in Problems by

2016-10-31 21:22 UTC: Connectivity to Web319 is intermittent from various locations. We’re investigating the issue at this time and will update this post when we have more information.

2016-11-01 00:55 UTC: Connectivity to Web319 has been restored. We’ll continue to monitor.

2016-11-08 23:24 UTC: Connectivity to Web319 is intermittent is once again intermittent. We’re investigating the issue at this time and will update this post when we have more information.

2016-11-08 23:38 UTC: Connectivity to Web319 has been restored following a reboot. We’ll continue to monitor.

-
-

[Fixed] Web533 offline

Posted in Downtime by

2016-10-19 21:49 UTC: Web533 is presently offline – we’re investigating the problem and will update this post as soon as we have more information.

2016-10-19 22:27 UTC: Web533 is back online. We’ll continue to monitor.

-
-

[Fixed] Payment system trouble

Posted in Problems by

2016-10-06 16:53 UTC: at this time, we’re unable to process manual payments and cannot set up new payment sources for automatic monthly billing. We’re working to resolve the issue and will update this post when more info is available.

2016-10-06 18:56 UTC: the underlying issue has been resolved, and the payment system should begin working within the next hour.

2016-10-06 19:36 UTC: the payment system is working normally at this time. We’ll continue to monitor for the next hour.

2016-10-06 20:36 UTC: the payment system has been working normally for the past hour, and we believe the issue is resolved.

-
-