You may have read about the ‘lightning strike’ and subsequent explosion that took out Amazon’s Dublin-based data center at the weekend, forcing its EC2 cloud computing service into unplanned downtime. It affected customers for up to 2 days in some cases. Amazon said in its statement:
“The transient electric deviation caused by the explosion was large enough that it propagated to a portion of the phase control system that synchronizes the backup generator plant, disabling some of them. Power sources must be phase-synchronized before they can be brought online to load. Bringing these generators online required manual synchronization.”
This isn’t all that unusual in itself, but questions have been raised about why the backup power systems didn’t kick-in. This is a massive data center we’re talking about here, so surely it was designed and built for such a scenario? You would certainly think so, and a report in Silicon Republic today has cast doubt on claims that a lightning strike was at the heart of the problem.
It seems that ESB Networks, an Irish electricity provider, has given a different version of events. A spokesperson from ESB Networks told Silicon Republic that the problem arose following a fault in one of its Citywest substations, noting that an alternate power source should have kicked-in automatically in less than a second.
The outage, according to ESB Networks, happened at 6.15pm on Sunday evening. The spokesperson told Silicon Republic:
“In relation to Amazon, it would have experienced less than a second (of downtime) when the centre would have been switched to an alternate supply.”
The spokesperson added that there was no report of an explosion or fire. And to compound matters, the Met Office said there was no record of a lightning strike in the Dublin area at the time.
It’s not clear yet whether Amazon was quick to jump the gun by blaming a lightning strike when something else entirely was to blame, but it’s the second major problem one of its data centers has experienced in four months, with another outage reported back in April, affecting some US-based customers.
Microsoft also experienced issues with BPOS, its online desktop application suite, resulting from power issues in Dublin at the weekend. The company said at the time via a Twitter feed: “European data power issue affects access to BPOS”, before saying a few hours later “BPOS customers are back online for EMEA customers.”
So it’s clear that something did happen in Dublin that caused more than one data center into downtime, but with conflicting versions of events there are still questions needing answered.
The Next Web has contacted Amazon for comment, and will update here once it has responded.
Article source: TNW http://feedproxy.google.com/~r/TheNextWeb/~3/zbqW86T7rws/