[monitoring] Web346 offline

Posted in Downtime by

2017-03-16 20:01 UTC: The networking services on Web346 are currently down and the machine is offline. We’re working to restore service at this time and will update this post when more information is available.

2017-03-16 22:06 UTC: Web346 is back online after our upstream network provider reconfigured a switch. We’ll continue to monitor for signs of trouble.

2017-03-16 22:26 UTC: Web346 has gone offline again. We’re working to restore service at this time and will update this post when more information is available.

2017-03-16 23:25 UTC: We’re still investigating the connectivity issue.

2017-03-17 00:24 UTC: We’re still investigating the connectivity issue.

2017-03-17 01:44 UTC: We’ve switched Web346 to a different OS kernel and it seem to be stable now. We’ll continue to monitor.

2017-03-17 15:43 UTC: Several hours ago, we determined that Web346 was being attacked. At that time, we took steps to mitigate the attack, and the server has been stable since then. We’ll continue to monitor.

-
-

[Fixed] Control panel and API

Posted in Problems by

2017-03-10 22:35 UTC: Our control panel and API was under heavy load for the past 10 minutes and may have been slow or unresponsive for some customers. The problem has been resolved and the panel and API are responding normally at this time.

-
-

[Fixed] Datacenter connectivity issue affecting mail system and dedicated servers

Posted in Downtime by

2017-03-02 22:15 UTC: A network connectivity issue in one of our data centers is affecting our incoming mail system. We’re working to restore service and will update this post as soon as more info is available.

2017-03-02 22:47 UTC: This issue is also affecting some of our dedicated servers: DWEB53, DWEB39, DWEB73

2017-03-02 22:52 UTC: Connectivity is now restored. We’ll continue to monitor.

2017-03-03 00:18 UTC: The cause of the issue was a faulty linecard in the data center. The problem has been resolved.

-
-

[Fixed] Web300 inaccessible

Posted in Downtime by

2017-02-26 07:15 UTC: We are investigating the issue and will update the post as soon as we have further details.

2017-02-26 11:15 UTC: The server is back online.

-
-

[fixed] Web367 read-only filesystem

Posted in Downtime by

Web367 is down with a read-only filesystem. We are currently looking into the issue and will resolve it as quickly as possible.

2017-02-11 18:33 UTC: Web367 is back online.

2017-02-19 01:30 UTC: Web367’s filesystem has gone read-only again.

2017-02-19 02:41 UTC: We’re rebooting the server to a rescue environment to run a filesystem check.

2017-02-19 02:50 UTC: No major problems were detected in the filesystem check, and the server is back online.

-
-

[Fixed] Intermittent errors on main website and control panel

Posted in Downtime by

Some users are reporting intermittent errors while using our main site and our control panel.

We’re currently working to restore service and will update this post when we have more information.

Update: Our website and panel should be working normally for all users now. If you do see any issues, please raise a ticket

-
-

[Fixed] Web491 inaccessible

Posted in Downtime by

We are investigating the issue and will update the post as soon as we have further details.

2017-02-02 18:52 UTC The issue has been resolved and the server is back online.

2017-02-03 14:30 UTC: The server is inaccessible again. We are working to resolve the issue as soon as possible.

2017-02-03 15:20 UTC: The server is back online.

2017-02-15 10:30 UTC: The server is inaccessible again. We are working to bring back the machine online as soon as possible.

2017-02-15 10:45 UTC: The server is back online.

-
-

[Fixed] Web367 operational issues

Posted in Downtime by

2017-02-01 23:20 UTC: We are investigating the issue and will update the post as soon as we have further details.

2017-02-02 01:16 UTC: Web367 has suffered a catastrophic disk failure. We’ve recovered some data from the server, and have the remaining data in our backups. We’re presently restoring the machine to new hardware and will notify affected customers with the new server details.

2017-02-02 02:48 UTC: The file transfer is 50% complete.

2017-02-02 05:17 UTC: The file transfer is complete. We’re still working on restoring database passwords and permissions. If you notice a problem with your site, please open a support ticket for immediate assistance.

2017-02-02 15:00 UTC: We were able to recover all the data on Web367 and brought the original machine back online.

-
-

[Fixed] Web220 inaccessible

Posted in Downtime by

2017-02-01 09:35 UTC: We are investigating the issue and will update the post as soon as we have further details.

2017-02-01 15:10 UTC: The issue has been resolved and the server is back online.

-
-

[Fixed] Web187 inaccessible

Posted in Downtime by

2017-02-01 09:35 UTC: We are investigating the issue and will update the post as soon as we have further details.

2017-02-01 15:10 UTC: The issue has been resolved and the server is back online.

-
-