Tony Posted September 4, 2009 Report Share Posted September 4, 2009 At 10:35 PM PDT we received notification from our monitoring systems that the Titan server was not responding. Upon further investigation it appears as if there is a network issue of some kind affecting all of our Seattle location. As to the exact cause we are not entirely sure we have not as of yet heard back from networking. We had recently posted notice of a problem that needed to be corrected on the network so it may very well be related http://www.hawkhost.com/forums/showthread.php?t=531 Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 Everything is now backup we have yet to hear from networking as to the cause of the outage. Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 We have confirmed it was a power outage of some kind. We are awaiting more information as to the cause. Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 I spoke to soon now everything is off line again. Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 Information we just received: At approximately 22:30 PDT on Thursday, September 3rd 2009, the NOC was alerted to a power/electrical issue at the Seattle Datacenter. The local NOC is currently investigating, and we will continue to provide updates as they become available. Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 Well everything is off line again related to the power issues. We have no ETA as of yet as to when things will be back online or what exactly caused the power issue. Link to comment Share on other sites More sharing options...
Tony Posted September 4, 2009 Author Report Share Posted September 4, 2009 We're online again the second portion was not a power issue but from first glance a network issue of some kind. We're still waiting confirmation on this though. Link to comment Share on other sites More sharing options...
Tony Posted September 5, 2009 Author Report Share Posted September 5, 2009 During routine maintenance of electrical switchgear in the SEA01 facility, a faulty logic board caused a static switch to disengage. This resulted in a disruption of power to downstream critical IT load. On-site vendor maintenance professionals quickly isolated the logic board as the root cause of the disruption and initiated procedures to replace the component and revert power back to affected customer equipment. SoftLayer Engineers were alerted in tandem to the disruption and began the process of bringing impacted servers back online once power was restored. Maintenance has been completed, and while no further impact is expected, NOC personnel will be closely monitoring the electrical infrastructure for the next 24 hours. SoftLayer appreciates your patience and apologizes for any inconvenience this has caused. Link to comment Share on other sites More sharing options...
Recommended Posts