Guasto OVH blocca migliaia di siti internet.

In mattinata si sono registrati numerosi malfunzionamenti sulla rete internet europea dovuti alla non raggiungibilità di alcuni nodi.
Il problema ha riguardato in particolare OVH, uno dei maggiori fornitori mondiali di servizi internet, che ha avuto 2 guasti quasi contemporanei  nell’infrastruttura di Strasburgo e di Roubaix.

La situazione sembra essersi risolta nel primo pomeriggio con il ripristino degli ultimi nodi.

Di seguito il comunicato ufficiale dal sito OVH:

Task Type: Incident

Category: Strasbourg

Status: In progress

We are experiencing an electrical outage on Strasbourg site.
We are investigating.

Comments:

Date: Thu, 09 Nov 2017 10:55:52 +0100

SBG: ERDF repared 1 line 20KV. the second is still down. All Gens are UP. 2 routing rooms coming UP. SBG2 will be UP in 15-20min (boot time). SBG1/SBG4: 1h-2h

Date: Thu, 09 Nov 2017 12:04:04 +0100

Traffic is getting back up. About 30% of the IP are now UP and running.

Date: Thu, 09 Nov 2017 12:44:01 +0100

Everything is back up electrically. We are checking that everything is OK and we are identifying still impacted services/customers.

Date: Thu, 09 Nov 2017 13:25:38 +0100

Hello, Two pieces of information, This morning we had 2 separate incidents that have nothing to do with each other. The first incident impacted our Strasbourg site (SBG) and the 2nd Roubaix (RBX). In SBG we have 3 datacentres in operation and 1 under construction. In RBX, we have 7 datacentres in operation. SBG: In SBG we had an electrical problem. Power has been restored and services are being restarted. Some customers are UP and others not yet. If your service is not UP yet, the recovery time is between 5 minutes and 3-4 hours. Our monitoring system allows us to know which customers are still impacted and we are working to fix it. RBX: We had a problem on the optical network that allows RBX to be connected with the interconnection points we have in Paris, Frankfurt, Amsterdam, London, Brussels. The origin of the problem is a software bug on the optical equipment, which caused the configuration to be lost and the connection to be cut from our site in RBX. We handed over the backup of the software configuration as soon as we diagnosed the source of the problem and the DC can be reached again. The incident on RBX is fixed. With the manufacturer, we are looking for the origin of the software bug and also looking to avoid this kind of critical incident. We are in the process of retrieving the details to provide you with information on the SBG recovery time for all services/customers. Also, we will give all the technical details on the origin of these 2 incidents. We are sincerely sorry. We have just experienced 2 simultaneous and independent events that impacted all RBX customers between 8:15 am abd 10:37 am and all SBG customers between 7:15 am and 11:15 am. We are still working on customers who are not UP yet in SBG. Best, Octave