Tony Posted May 23, 2009 Report Share Posted May 23, 2009 Our Dallas datacenter's is currently experiencing problems in their server room #2 which houses our Pluto and Saturn servers. At this time we have no idea why they're out but we already have a technician investigating why our machines are off line. Link to comment Share on other sites More sharing options...
Tony Posted May 23, 2009 Author Report Share Posted May 23, 2009 Update from datacenter: Datacenter engineers have detected power anomalies in server room 2 (sr02.dal01). The Emergency Response Team has been notified and engineers are working to identify and resolve the issue. As the situation unfolds, more information will be available via the emergency communication center inside the public and private portal. Due to the high volume of tickets and calls that may arise during this issue, delays may occur as engineers work to quickly and efficiently communicate all information. We appreciate your patience and cooperation. Updated information will be posted as soon as it becomes available. Link to comment Share on other sites More sharing options...
Tony Posted May 23, 2009 Author Report Share Posted May 23, 2009 We're back up but we have nothing else to report as to the cause or anything of that nature. Link to comment Share on other sites More sharing options...
Tony Posted May 24, 2009 Author Report Share Posted May 24, 2009 At approximately 2:08pm CDT, Datacenter engineers were alerted to a power failure in portions of sr02 and sr03 in the dal01 facility. Datacenter engineers immediately began to diagnose the root cause of the issue and to restore power to the affected areas. A full datacenter emergency response team was called in to manage the event and to ensure that all affected servers were brought back online. The root cause of the issue has been determined to be a power surge in the circuit due to a failed capacitor in a UPS. The UPS in question was immediately removed from service as the datacenter staff reset main breakers in the affected PDU's that service the datacenter floor. Future mitigation: Service technicians, electricians and manufacturer engineers worked throughout the day and night to replace all of the failed components of the UPS. After replacement, the UPS was put through a full series of tests to verify operational capacity. Link to comment Share on other sites More sharing options...
Recommended Posts