This page has been archived and commenting is disabled.
Someone Tripped Over The Cord
Our network provider had a rather exciting failure. First a router popped (9:15 ET) then they had a systemic power failure (9:53 ET) which, while it was covered quickly by backup, rebooted a number of boxes, including Zero Hedge's. The outage took down a bunch of sites including some other "famous names." Because we love you so much, we rebuilt the filesystem and gave the database a good scrub for good measure once we got our connectivity back- this meant we took a bit longer than some other sites to come back up. Things are back to normal (or abnormal) now. Do not be alarmed. Continue swimming naked.
»
- 2650 reads
- Printer-friendly version
- Send to friend
- advertisements -
hmm, and I thought that was me stumbling while drunk again...
"rebooted a number of boxes" Thats HOT
I do have this fear that someday ZH will just disappear, only to return months later in book form outlining this great social/market/anthropological study.
Or all the content gutted and replaced with articles from TheStreet.com.
I am Chumbawamba.
my worst fear is replaced with a 24/7 loop of mad money
Absolute worst? 24/7 loop of Larry Kudlow AND Jim Cramer. Top that.
Can we add Larry King in there somehow?
Sorry, only "serious" economic talking heads allowed. Larry King is too celebrity-oriented for a ZH replacement.
Larry King is a serious financial talking head now that he lost a million to Madoff. Larry could do CNBC easy:
Larry King on CNN:
Seinfeld: "Do you even know who I am?"
Larry: "Jewish guy, Brooklyn, right?"
Seinfeld: “Can we get a resume in here for me, for Larry to go over?”
Larry King on CNBC:
Jamie Dimon: "Do you even know who I am?"
Larry: "Jewish guy, Brooklyn, right?"
Jamie Dimon: "Upper East side...Can we get a resume in here for me, for Larry to go over?”
It would be better than Kudlow, Cramer or any of the usual CNBC ass hats and ass hat-ettes.
Good to hear. I was beginning to worry something bad happened.
Anytime ZH disappears, I imagine Marla looking out her window for the black helicopters over head and shooting her SIG 226 9mil at NSA/CIA/MI6 agents peering over the cubicle dividers at ZH central.
1. I don't carry a sig. 2. Cubicles are concealment, not cover.
LOL
I stand corrected. Marla shoots her bazooka through the flimsy cubicle walls those nasty agents mistook for cover.
Redundant, replicated servers rooms (in different countries) sound like a good idea right now, no, Marla?
Anyway, good to see you back online. Illuminati-induced super-secret-alien-technology EMP electrical failure or not.
Two words: Faraday Cage
Hmmm... "Swimming naked" in a Faraday Cage? Interesting concept.
Two words: Cash Money.
:)
Hmmm... So it is swimming naked in cash money in a Faraday cage?
Marla, you are arousing my... errr... interest.
Then again, maybe not.
True dat. I thought you might have been experiencing what some people have been of late with popping a service impact bug on IOS (Cisco) maybe on your service's router. With the introduction of 4-byte ASNs (Autonomous System Numbers), lovely hax0rz crafted a newly devised method of injecting a specifically crafted prefix into the global route table allows for the BGP process to be reset on older IOS code.
http://www.cisco.com/warp/public/707/cisco-sa-20090729-bgp.shtml
Everyone has their scabs, just a matter of which kind you like to have....
'Two words: Faraday Cage'
Kinda like a tin foil hat for the Zerohedge server ;)
A good line filter at the mains makes all the difference. I'd chip in some $$ to help with the cost of redundancy and for a bigger pipe (hint).
A line filter doesn't help when an upstream transfer switch conks out, leaving you with neither utility nor UPS power. How about you leave the engineering to the engineers and just go buy a hat at the online store?
Read my post about contributing toward redundancy. Of course you need two locations and UPS backups at each. I've been doing this 25 years.
And furthermore, I was referring to using a quality line filter instead of a Faraday shield - one with an isolation transformer to filter out all the HF trash. With that attitude, it must suck to be you
No, not in different countries. Maybe multiple places in same country (Sweden I believe). Otherwise you run the risk of one of those servers being confiscated and going through the logs by 'authorities'.
Hmmm... "whois" returns a registrar (Marla Singer) based in Lichtenstein.
And "traceroute" returns a web hosting company (prq.se) based in Sweden. The front page of said hosting company makes for interesting reading. To say the least.
Ever heard of the concept of blank multiple proxy and replication servers? Just because you have multiple servers does not mean all can be seized (or taken down by power failures) in one go. Just a thought.
"Wikileaks.org" is one of the famous names that Marla is referring to, I think.
indeed, HD's are so insanely cheap nowadays that you can't afford to have no backup. (Tip: Use Acronis to make a 1 to 1 clone backup can even be done from RAID to one disk from which you even can startup or put vack to RAID - Go for Seagate HD- most reliable)
Servering is hard.
I thought it was your site crashing due to Heavy Traffic of converted transparency seekers.
I figured the Fed cut the cord so you couldn't make snarky comments while Geithner was speaking...
Whew, you guys didn't pull a Lou Dobbs.
Thanks for not calling them "boxen" marla.
I panicked and went to mibbit with an SOS...x
http://www.youtube.com/watch?v=MqfBApQ1NHk
Didn't have caffiene or ZH this morning :-(
but the afternoon seems like it will progress nicely
also...just recognized that little intro pic...hilarious
"Mr. Bond, they have a saying in Chicago: 'Once is happenstance, Twice is coincidence, Three times is enemy action.'"
HAHAHAHA...
Oh dear oh dear oh dear
Oh dear oh dear oh dear
Oh dear oh dear oh dear
Oh dear oh dear oh dear
I was thinking maybe you got raided.
I thought it was the hackers at GS killing the messenger.
I though THEY caught you... good that you're back.. or is it really you? ;)
Now THAT'S the real question, isn't it. Though I would like to think I could recognize the Marla swagger a mile away.
While there might be 40 Tylers (or so the MSM says) there is only one Marla Singer.
That picture from The Naked Gun is great.
Someday the twenty and thirty somethings at the NSA will take zh down and it won't come back up.
that's when i'll know that it is truly all over and i'll short the dollar big time that day.
Thank you for the update, Marla. In all seriousness, it does worry me when zh goes down because you know those phucks just hate you guys.
If the computer geeks decide to revolt, the world shuts down. No need for pitchforks.
On an unrelated matter, BofA had a major computer problem yesterday that must have cost them another 20,000 customers. Their online transferring capability went beserk.....repeating transfer amounts on " try again" submittals from customer-to-customer accounts. Their 800 line had a half hour hold backup. From a reliable source who is now a rabidly pissed off former BofA customer ( not me ).
Mexican's have been on my ass the last 3 days.
static.customer-201-116-35-190.uninet-ide.com.mx [201.116.35.190] failed - POSSIBLE BREAK-IN ATTEMPT!
AND... at about the same time ZH was taken down, the LHC was ALSO taken down by a so-called "power failure"!
http://www.theregister.co.uk/2009/12/02/lhc_power_failure_again/
Coincidence? I THINK NOT!
(All of this said firmly tongue-in-cheek)
The title "Someone Tripped Over The Chord" is probably more right than your ISP wants you to know.
It has been decided by the ZH IT group that during the next outage, a loop tape of Ed Sullivan doing Kate Smith while she sings god bless America on Chico's bar stool, wearing fez .. While Ben Bernanke looks on.
russian hackers do not sleep! lol
I wonder if there is a manila envelope sealed by TD with the words "In The Event ..." in someone's personal safe, somewhere in the world.
And I wonder what is inside the envelope ....
I recommend duct taping the wire to the socket.
Tripped on a cord - that's a relief.
Everytime ZH is unreachable after a couple of tries I immediately assume that it is the first cyber attack wave as the New World Order tanks roll, battalions of stormtroopers deploy, and martial law is imposed; among the chaos of machinery in motion and heavily armed soldiers on the march, a dark uniformed Himmleresque figure stands astride an APC before an enormous unfurled banner of Lord Blankfein, calmly smoking a cigarette, clutching a list of ZH contributors, posters and lurkers, all targeted for passage by cattle car to the "Re-Education Camps" in the east, and tersely barking orders to root out and find "these traitors to the Empire" before they can escape.
It's either that or I assume my router needs to be rebooted.
"It's either that or I assume my router needs to be rebooted."
LOL
Either the end of the world as we know it (TEOTWAWNI) or that damn Verizon/Cox/whatever modem needs a kick in the back side. Talk about duality and extremes.
err... could anyone explain what a "systemic power failure" is ?!
Heart attack? That's not what worries me, though. It's the "they rebooted ZH box", aren't all processes running in virtual machines now?
"Someone Tripped Over The Chord"
Everyone calm down and dump all those dollars you bought. No need to help Ben out tomorrow.
You'd be surprised how many outages are caused by someone at the network provider tripping, bumping, kicking, disconnecting, sweeping, the frikken cord! That's why rule #1 in high volume, industrial size, megaserving is... upon any outage check the cords 1st. Then freak out.
-u4yeah4