My IT Weekend Nightmare

cthomer5000 · 04-03-2005, 07:58 PM

Well, I couldn't log on to AOL Instant Messenger for about 1/2 an hour yesterday.

jeff061 · 04-03-2005, 07:58 PM

I know someone out there can top this, but here is the low down of this past weekend.

I am in the process of moving from our current location to a new one. This includes moving two 42u server racks, 100% full of servers. Well yesterday the movers moved them to the new building. After unwrapping one of the racks it became immedatly apparent they had dropped it(i have pictures, for insurance/legal reasons). As in knocking it over from full height, 7 or so feet, til it was lying on its side. The rack was warped, the top six servers were destroyed. This was a PRODUCTION RACK. Of course they denied it, even said they couldn't see what was wrong(which was kind of impossible) We are pretty much an outsourced IT and development enviroment for an organization(an state organization), things had to be up by tomorrow.

So I just finished a two day bender swapping around hard drives(all of which survived the crash somehow) from production machines to test machines with the same hardware platform, and rebuilding any servers as needed.

This on top of helping out with a network reconfiguration. Not to mention an hour commute from home to work.

This sucked, anyone else have any fun stories?

Dutch · 04-03-2005, 09:08 PM

I feel for you, I hope you had everything backed up!

Like I've told others, "I haven't met a server I haven't crashed."

I've spent a few all-nighters recovering servers. All I can say is be prepared for hardware to fail and make sure you have your data backed up. Because if you don't, it's your ass.

04-03-2005, 07:58 PM	#2
jeff061 Grizzled Veteran Join Date: Nov 2003 Location: MA	My IT Weekend Nightmare I know someone out there can top this, but here is the low down of this past weekend. I am in the process of moving from our current location to a new one. This includes moving two 42u server racks, 100% full of servers. Well yesterday the movers moved them to the new building. After unwrapping one of the racks it became immedatly apparent they had dropped it(i have pictures, for insurance/legal reasons). As in knocking it over from full height, 7 or so feet, til it was lying on its side. The rack was warped, the top six servers were destroyed. This was a PRODUCTION RACK. Of course they denied it, even said they couldn't see what was wrong(which was kind of impossible) We are pretty much an outsourced IT and development enviroment for an organization(an state organization), things had to be up by tomorrow. So I just finished a two day bender swapping around hard drives(all of which survived the crash somehow) from production machines to test machines with the same hardware platform, and rebuilding any servers as needed. This on top of helping out with a network reconfiguration. Not to mention an hour commute from home to work. This sucked, anyone else have any fun stories? __________________ Last edited by jeff061 : 04-03-2005 at 07:59 PM.

04-03-2005, 09:08 PM	#3
Dutch "Dutch" Join Date: Oct 2000 Location: Tampa, FL	I feel for you, I hope you had everything backed up! Like I've told others, "I haven't met a server I haven't crashed." I've spent a few all-nighters recovering servers. All I can say is be prepared for hardware to fail and make sure you have your data backed up. Because if you don't, it's your ass.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)