SWITCHlan Trouble Tickets

Transparency is very important to us. We therefore publish all trouble tickets about issues that have an impact on our customers. We show both currently open tickets as well as all closed tickets.

Ticket 20210921_1

Ticket Number: 20210921_1Ticket State: CLOSED
Ticket Opened: 2021-09-21 13:13Ticket Closed: 2021-11-08 16:44
Ticket Description: Fiber cut on NEA3R transatlantic link

Problem Description:

GEANT Ticket reference #2021091934004888

> The above service is still down since 19/09/2021 22:00:03 UTC. Concerned NOC
> has informed that the outage has been caused by a subsea cable. No ETR has
> been provided yet. Further updates to follow.

Affected:

From 2021-09-20 00:00 until 2021-11-08 16:45
Impact: Total loss of connectivity
Service: P2P/OPN
Sites: L2VPN-RMUE-INDIANAPOLIS


Actions:


2021-11-08 16:44
The service is up and stable. The provider has confirmed the subsea fault has
been repaired permanently. Incident resolved.
Closing ticket.

2021-11-01 15:00
The concerned NOC has advised during the course of final testing to begin the
continuation of reparations of the deep-water fault on AEC-1, an issue was
detected approximately 400nm to the west of the fault. As a precaution and to
ensure maximum system performance and stability, Aqua Comms has decided to
undertake this repair activity immediately. The repair vessel is making its
way towards the new fault location and repair operations begin immediately
upon arrival providing weather conditions permit. The ETR is currently
expected to be nine more days. Further updates to follow.

2021-10-29 07:21
GEANT OC have been informed repair work has resumed, this is expected to last about 5 days however this may be delayed due to inclement weather.

2021-10-27 20:45
GEANT OC have been informed the cable repair vessel has recovered the cable from the sea bed however the repair is currently on hold due to incliment weather.

There is currently no ETR, however further updates to follow.


2021-10-23 09:54
The repair has been put on hold due to incliment weather in the area. The recover and repair process is expected to resume in 6 days. Due to
this, there is currently no ETR available. Updates will be provided as they
are received.

2021-10-19 07:37
The concerned NOC has advised that the vendor engineers have developed a plan
for system repair of the AEC-1 subsea cable. The cable repair vessel has
recovered the cable from the sea bed, but the repair has been put on hold due
to inclement weather in the area. The recovery and repair process is expected
to take 11 days but is dependent on sea levels and overall weather conditions.
There is currently no ETR, further updates to follow in due course.

2021-10-13 11:50
PLEASE NOTE that we do not expect any updates in the next 11 days, so please refrain from asking us for more updates until October 24th.
We will relay information as soon as we receive them.

2021-10-13 11:47
Latest info via GEANT:

The concerned NOC has updated on 11/10/2021 18:01 UTC that the cable repair
vessel has arrived on repair grounds and is commencing cable recovery
from the sea bed. The recover and repair process is expected to take 11 days but is
dependent on sea levels and overall weather conditions. No ETR is available at
the moment. Updates will follow as they are received.


2021-10-11 12:49
The services have stayed down since 19/09/2021 22:00 (UTC) due to ongoing
AEC-1 subsea fiber cut. A repair vessel has departed the UK marine depot on
October 3rd 2021. The repair activities are dependent on weather conditions.
No ETR is currently available. Updates shall be provided as they are received.

2021-10-07 13:58
Services remain unavailable. The repair vessel is en route, however, the ETA has now been extended to 9 days due to adverse weather conditions. Further updates will be provided as they are received.

2021-10-05 12:32
GEANT OC have been informed that the repair vessel that departed on the 3/10/2021 is due to arrive at the fiber break location in approximately 6 days. Due to the nature of the work. No ETR is currently available.
Further updates to follow

2021-10-01 12:40
GEANT OC has been informed the repair vessel will be departing the UK marine
depot on the 2nd of October. ETA is estimated to be up to 6 days. No ETR is
available at present. Further updates will be provided as they are made
available.

2021-09-27 15:28
GEANT OC have been informed a repair vessel will be departing the UK marine
depot on the 29th September. ETA is estimated to be up to 7 days. No ETR is
available at present.

Further updates to follow

2021-09-22 07:05
The concerned NOC has reported the reason for the outage is an AEC-1 subsea
fiber break. There is currently no possibility of a service reroute and
services may not resume quickly. No ETR is available at the moment. Updates
will be provided when they are made available.


2021-09-21 13:26
The ETR will be communicated once the GEANT ticket is updated with that information



All times are in local Swiss time CET / CEST.
For all questions about this ticket, please send mail to noc@switch.ch
or call +41 44 268 15 30.