Power Issues:-
Though extremely rare that datacenters should suffer power issues, we had a power related outage starting at 12:53 PM to 1:18 PM.
About 50% of the machines were up at 1:18 again many after an un-planned reboot at about 1:18 PM.
Network Issues :_
Of the 2nd half of our machines 50% were powered on and their network restored at 1:53 PM and another 50% were affected by a network issue related to routing rule that wasn’t made static and restored at around 2:14 PM.
We shall individually communicate with all the clients about the downtime issues and provide mitigation solutions.