SWITCHlan Trouble Tickets

Transparency is very important to us. We therefore publish all trouble tickets about issues that have an impact on our customers. We show both currently open tickets as well as all closed tickets.

Ticket 20090503_1

Ticket Number: 20090503_1Ticket State: CLOSED
Ticket Opened: 2009-05-03 10:58Ticket Closed: 2009-05-04 14:39
Ticket Description: Router swiFHSG2 unreachable after power outage

Problem Description:

Our router at FH St. Gallen has been unreachable since 06:55 Sunday morning.
It has failed to come back up again after a software crash.
A manual boot sequence was required to bring it back up again.
A new image has been installed and was tested with a cold boot and should now be working properly.


From 2009-05-03 06:55 until 2009-05-03 12:18
Impact: Total loss of connectivity
Sites/Services: FHSG, PHTG


2009-05-04 11:20
TS from the FHSG IT-Staff called and confirmed that there was no power outage at their premises.

2009-05-03 12:18
Router is back online. All connections restored.
Tested around with the OOB access and after some resets it also seems to be working again now.

2009-05-03 12:05
As suspected, router was stuck in ROMMON.
Manually booted a software image. The outage was due to a software crash around 6:55.
Upgraded to latest firmware and cold booted again to test if it comes up properly.

2009-05-03 10:30
No conclusions yet, OOB is not possible, suspecting a wrong boot variable, so router might be in stuck in ROMMON. Contacting Mr. Gnehm for on-site remote hands. Will be there in app. an hour.

2009-05-03 09:46
Investigating logs to find out what happened. Seems to be either a power loss or software crash.

2009-05-03 09:45
An engineer at FHSG disconnected and reconnected power to the router in an attempt to restart it, but without success.

2009-05-03 09:00
Attempts to reach the router through out-of-band (OOB) management failed. Trying to reach people with access to the site.

2009-05-03 06:55
The neighboring routers (swiSG2, swiKR2, and swiBU2) lost connectivity with swiFHSG2. We assume that there was a power outage at the site. The router obviously didn't come up after the outage.

For all questions about this ticket, please send mail to noc@switch.ch
or call +41 44 268 15 30.