Ticket 20221026_2

Ticket Number:	20221026_2	Ticket State:	CLOSED
Ticket Opened:	2022-10-26 13:19	Ticket Closed:	2022-10-26 17:43
Ticket Description:	Potential fiber cut between CERN and our amplifier site in Orbe (26.10.2022)

Problem Description:

We observed no more light passing the CERN-Orbe link since 12:54 (CEST). We suspect a fibercut and are making contact with the fiber provider.

One of our 200G backbone links (CERN-Bern) is affected, but all traffic can take alternative routes. Additionally a few optical links may have flapped as the protection circuits were engaged and are now running on their backup paths.

Affected:

From 2022-10-26 12:54 until undefined
Impact: no more redundancy
Service: P2P/OPN
Sites: CERN-EQUINIX, L2VPN-RKAU-INDIANAPOLIS, L2VPN-RKAU-SANTACLARA


From 2022-10-26 12:54 until undefined
Impact: no more redundancy
Service: P2P/OPN
Sites: BELWUE-KIT-CE, L2VPN-RMUE-INDIANAPOLIS, L2VPN-RMUE-SANTACLARA, SYNGENTA-INTERNET2, SYNGENTA-JANET

Actions:

2022-10-26 17:43
The technician has arrived in Orbe and switched our connection to a fiber pair, that takes the originally intended route, instead of the wrong one taking a detour in Gland, that we were accidentally on before.

All our services are back up, and redundancy is reestablished. Closing ticket.

2022-10-26 16:35
With the help of a local contact at CERN who graciously did an OTDR measurement for us, the issue was localized to a fiber interruption 43 km away from CERN, likely in Gland according to the fiber provider.

Our service will be moved to a different fiber pair in the same cable in the next few hours once the fiber provider's technician arrives in Orbe.

2022-10-26 14:28
The fiber provider reports that other services on the same cable, including their own, are unaffected. We are investigating further.

2022-10-26 13:45
Adding other sites that have one of the paths affected.

---

All times are in local Swiss time CET / CEST.
For all questions about this ticket, please send mail to noc@switch.ch
or call +41 44 268 15 30.