"A million bloggers cried out.. and were suddenly silenced"

SirFozzie · 01-20-2005, 02:51 PM

Just read the cause of LiveJournal's going down ( a thing of great consternation amongst the blogging subset) for a week or so.. and jeez.. somebody's gettin a-sued over this. Funny tho, how one little thing cascades all the way down the line.

Why we lost all our power...
Another customer in the facility accidentally pressed the EPO button, then depressed it, replaced the protective case, and left the building. Intenap all thought it was their UPS systems failing, but then logged into them, saw EPO shutdown notifications, and couldn't find any EPO cases open or pressed, so probably freaked out for a bit thinking there was a short in the walls that triggered the EPO, only to get a confession a day or so later.

EPO, by the way, stands for Emergency Power Off and it's a national fire/electrical requirement for firefighters to be able to press these big red buttons near all exits that turn off all power in the entire data center. This is the second time this has happened to us in the years I've been there. The first time the button was unlabeled and unprotected and some dude thought it opened the door. This time we have no clue why it was pressed... maybe that dude tripped and fell onto it... mystery.

Internap will be putting alarms and tamper-proof indicators on the plastic cages surrounding the EPO buttons now, though, so at least if this happens again in the future they'll know why.

Whoever triggered that is screwwwwwwwwweeedddd.

finkenst · 01-20-2005, 03:19 PM

it's not really funny...

Where i work, we had that problem. A security guard hit the power button and down went the entire data center (yikes!)

after that, if you had access to the data center you went to training to show you the new buttons and covers and the alarms that are setoff if you raise the cover.

Glengoyne · 01-20-2005, 04:26 PM

Worked in a bank data center once, and a temp was escorted into the data center, she asked to wait by the manager. While waiting she decided to take off her coat, and hang it on the red "knob" not far from the door. Thank God I was on vacation that day. Oh the temp never logged an hour.

sterlingice · 01-21-2005, 03:16 AM

Yeah, I'm sure this didn't result in a collective "WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAH" from the Live Journal community.

SI

01-21-2005, 03:16 AM	#4
sterlingice Hall Of Famer Join Date: Apr 2002 Location: Back in Houston!	Yeah, I'm sure this didn't result in a collective "WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAH" from the Live Journal community. SI __________________ Houston Hippopotami, III.3: 20th Anniversary Thread - All former HT players are encouraged to check it out! Janos: "Only America could produce an imbecile of your caliber!" Freakazoid: "That's because we make lots of things better than other people!" Last edited by sterlingice : 01-21-2005 at 03:16 AM.

01-20-2005, 03:19 PM	#2
finkenst College Benchwarmer Join Date: Jul 2003 Location: usually sunny SoCal	it's not really funny... Where i work, we had that problem. A security guard hit the power button and down went the entire data center (yikes!) after that, if you had access to the data center you went to training to show you the new buttons and covers and the alarms that are setoff if you raise the cover.

01-20-2005, 04:26 PM	#3
Glengoyne Grizzled Veteran Join Date: Sep 2003 Location: Fresno, CA	Worked in a bank data center once, and a temp was escorted into the data center, she asked to wait by the manager. While waiting she decided to take off her coat, and hang it on the red "knob" not far from the door. Thank God I was on vacation that day. Oh the temp never logged an hour.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)