Our new platform is already available at www.gandi.net

Go to the new Gandi

We have lost contact with our infrastructure at Telehouse1 (Jeuneurs) in Paris as of 03:11 CET (02:11 GMT).  Our technicians are en-route to investigate the problem.  

 

Affected Gandi services are:

1/3 of the DNS systems, whois for domain registry, and mail redirection service.

 

We will update here as we obtain more details.

 

UPDATE: 04:01 CET (03:01 GMT) - our core router at Telehouse1 had suffered a system crash resulting in the outage of this site.  Our engineer successfully restarted the router and we have obtained crash dump information from the router for analysis.  All services are once again operational.


We are currently experiencing an abnormally increased load on the incoming mail spools  on the GandiMail service.  As a result, new mail deliveries may be slower than usual.  Our teams are investigating the source of this increased load and we will keep you updated as we have more information.

 

Update: 14:00 : The slow spool performance is related to an increased load on the antispam/antivirus filtering on the mail spools.  Our teams are actively working to resolve the issue as soon as possible.  Inbound mail is still being delivered, but of course at a slower rate.

 

Update: 17:50:  Our teams have isolated the issue and have tweaked the processes on the antispam filters to further optimise performance.  All mail in the spools have been delivered to the recipient mailboxes and the system is now running nominally.

 

We apologise for any inconvenience caused by the slower than normal delivery of mails today.


A problem with one of our storage units has led to a disruption in mail for several thousand email mailboxes. We are currently working to restore service as soon as possible.

Please accept our apologies for the inconvenience.

The technical team

 

14:24 GMT: We have identified that the problem was caused by data corruption. We are corrently working on repairing the file system.

 

16:16 GMT:  The filesystem has been found to be severely corrupted.  Our technical teams are investigating whether it is possible to recover any data on the affected filer.  We will keep you updated with any further information/progress.

 

12:00 GMT (1 Dec):  The work was completed to rebuild the affected filer last night and undelivered mails still in the queue will have been delivered overnight.  Unfortunately the filesystem corruption was replicated on the resilient disk arrays which meant that we were sadly unable to recover the data for the affected mailboxes.  These mailboxes have been brought back online, but unfortunately are empty for users accessing via webmail or IMAP.  We have sent further communication to customers affected by this regrettable event.  We have put measures in place to mitigate any repeat occurence, and will be further developing and hardening our mail infrastructure. On behalf of the entire Gandi team, please accept our sincerest apologies for this most regrettable 'first'.



We have encountered an issue with one of the GandiMail filers. A limited number of customers may be unable to access their mailboxes on the affected filer from yesterday evening at 8h24 PM. Our technical team worked to resolve the issue yesterday evening but a forgotten configuration defect was only fixed today at 1h20 PM.

The service is now fully functional. Emails from the night are currently being delivered to these mailbox.

We apologise for the inconvenience caused by this abnormally long incident.


We have encountered an issue with one of our mailbox filers.  Maintenance is underway to correct the issue. A minority number of users may experience disruption of mail service during this maintenance.

 

We apologise for the inconvenience.

 

Gandi

 

Update: 2010 03 09 / 12:45CET:   This maintenance has now been completed and the service is operating nominally.


Some customers may have experienced some degradation or a brief outage of the Gandi Mail service for mailboxes located on the affected switch module.  The Gandi Website may also have experienced slower performance.

 

The affected card was replaced and all services are now fully operational as of 19:54 CET.

 

We apologise for any inconvenience this may have caused, and we are investigating with our supplier as to the cause of the hardware fault.


Page   1 2 3 4 5
Change the news ticker size