A network issue did impact ns6.gandi.net, our secondary DNS server.
Thus, it has been re-enabled in less than 10 minutes by our technical team.
We currently analyze the root cause of the problem now.
Sorry for the inconvenience this issue caused to you.
We will proceed to the migration of the hosting emergency console.
This maintenance will occur on Monday, the 23rd of June 2014 CEST (Paris timezone).
It should take a few minutes, the impact will be the connection of the IaaS (VM) emergency console, the PaaS/Simplehosting instances console, and the IaaS statistics on the web control panel.
Sorry for the inconvenience this maintenance may cause to you.
An emergency maintenance will occur on our corporate blogs as the Gandi Bar, the Kitchen, Open.gandi.net, Pypo.gandi.net, and our AS website too (Autonomous System 29169).
The blogs and websites will be unreachable for a few minutes.
The maintenance window will take place between 11PM and 12PM, on Wednesday 18th of June 2014 CEST (Paris).
Two of our links between FR and US are down. Due to that, performance is a bit degraded (more latency than usual).
Our team is working on it.
Update: The issue has been resolved.
Our operations team will perform an emergency maintenance on storage units today, Monday 9 June 2014.
Following the discovery of an intermittent but serious network issue, Gandi teams have determined that a rolling maintenance will be necessary.
We regret that, while most of the affected systems will simply require migration and no interruption in service, some will almost certainly require restarting. We will endevor to make these interruptions as short as possible, and only perform them when absolutely necessary.
We are starting with dc0 (Paris) this week. We will proceed on to dc2 (Luxembourg) on Monday, June 9.
The issue is not detected on dc1 (Baltimore) at the moment but, if necessary, we will proceed to fix it there. We apologize for any inconvenience this may cause.
Alert 10:20 AM [Paris Time]:
An incident is currently impacting our email services.
Our team is working on solving this issue as soon as possible. Please accept our apologize for the temporary service interruption.
Edit 11:20 AM [Paris Time]:
The Mail Incident is now over and resolved.
Zone files updates may be delayed.
Additional information for impacted users 12:30 PM [Paris Time]:
We confirm that this incident will not have any impact on your e-mails, which will be delivered with a slight delay. No loss will be noticed.
A more detailed timeline is available
We experienced an outage on the Gandi mail platform this morning. The outage was due to human error, rather than any failure of equipment or software.
Here is the timeline (in UTC):
14:57 - A human error was made that introduced a problem for customers connecting to Gandi's email infrastructure.
15:00 - Notification of the outage posted to Gandi's web site
15:06 - Physical connectivity restored. One machine unresponsive.
15:23 - Full connectivity and machine function restored.
In summary, some 15,975 mailboxes were not accessible for checking received messages or sending emails from 14:57 to 15:23 UTC. No data was lost.
We apologize for any inconvenience this incident may have caused.
Some physical machines hosting IaaS VMs are unreachable due to an issue we are currently analyzing.
We are fixing the issues and restarting the VMs on other physical machines as soon as possible.
Thank you not to do any operation on your VM until the emergency maintenance is ongoing. and not finished.
At the end of the maintenance, if your server does not respond well, please contact our hosting support team by mail using the 'blocked server' option.
Sorry for the inconvenience this issue may cause to you.
UPDATE 12h20 : the situation is back to normal, we are still analyzing the metrics and the logs.