Page 1 of 1

Lasts Nights Outage

PostPosted: Sun Mar 15, 2009 7:13 am
by Kelley Graham
FROM DREAMHOST (remember we have a facebook group where i post status updates: http://www.facebook.com/group.php?gid=79859180168)
********begin post from dreamhost********
Mar 14
7:54 pm
Issues with our Homie cluster
Posted (March 14th, 2009 at 7:54 pm PST) by danwy

We are currently experiencing issues with one of our server clusters, homie. If your site is on this cluster and it is currently down, this is the reason why. Our admin team is aware of this and is on the phone with our datacenter right now trying to find the cause. We don’t have any additional information at this time, but we will update this post as soon as we have more specific details. We apologize for any inconvenience this causes you and we hope to have everything back up shortly.

Update: Sorry we didn’t include this earlier. Here’s a list of servers that may be experiencing issues:

barker bonanno castellano castiglia genovese mangano mcgurn rothstein scalise schultz spillane spilotro

Update: This issue was caused by a power strip failure in one of our server racks. We have the datacenter engineers on their way to the datacenter to resolve the issue. We don’t have an ETA on when things will be fixed, but we are doing all that we can to remedy this issue as soon as we possibly can.

Update: For the most part, this issue has now been resolved. The datacenter engineers were quick to respond and resolve the problem with the circuit breaker. There was a small handful of servers that weren’t booting up correctly, so we had to go through and manually reboot them. We have most of the services back up and running, but there are still a few PS servers that we’re still working on. We should have those all back up and running shortly. We’ll post one final update once we’re confident everything is resolved.

Update (1:39am): Alright, whew. Everything should be fine now. What actually happened was a circuit in the datacenter blew and it just so happened that the switches that your machines are connected to were out because of that. It took some time to get a tech from the datacenter in there to reset the breaker and then after that I had to go and manually check each machine. The DreamhostPS and PS Mysql customers had some networking issues that also slowed things down. I apologize for the downtime! If you’re still having trouble, please send a message to our support staff.
***********end dreamhost post************
best regards,

Re: Lasts Nights Outage

PostPosted: Sun Mar 15, 2009 10:57 pm
by nianfong
so basically, the server up and said "Homie don't play dat!"? ;D

Re: Lasts Nights Outage

PostPosted: Mon Mar 16, 2009 7:51 am
by Kelley Graham
yeah... dreamhost used to be rock solid...