GoGrid West Coast Goes Down – AppNeta is There
At 2PM EST yesterday (Tuesday, October 16th), I noticed something was a bit off with our virtual network performance management appliance hosted at GoGrid in California’s Bay Area. I say “a bit off,” as in the appliance appeared completely offline. I tried logging into their management portal to no avail. By looking at network paths monitored to the virtual appliance, we were able to assess that the GoGrid access router was up. However, the datacenter network connecting our host to the router was down. Hmmm. Although we were no longer able to monitor to and from the data center because of the broken connectivity, we were able to spot the blackout right as it was happening.
Normally when connectivity is lost, it is preceded with adverse performance indicators such as jitter and packet loss. This incident was different because it was a complete network connectivity outage, as if someone had cut the cable or powered off a non-redundant element. A total GoGrid blackout. Nothing we saw in our monitoring before 2:00PM EST indicated that a blackout was on the way.
Connectivity was regained at 2:45PM EST, and we were once again able to begin monitoring to and from the data center.
Was your organization impacted by this outage? If so, what happened on your end?
Our apologies to you and your customers once again for this issue that you encountered yesterday. We take these rare instances very seriously. The GoGrid management console was restored within 30 minutes of experiencing the issue and full network connectivity was restored shortly after that. Our goal is to maintain the highest uptime and performance standards in the cloud industry so rest assured that we are doing a detailed analysis of the incident in order to prevent it from happening in the future. We value you as a customer and partner so please don’t hesitate to contact us should you have further questions or concerns.
Sincerely,
Michael Sheehan
Technology Evangelist for GoGrid
Once again, the cloud is not an end all solution. Clients need to have redundant architecture for mission critical aapplications.
@Bob S,
This isn’t a “cloud” issue. These types of things happen at data centers (internal and external) and server closets around the world regularly. I personally believe that because something has the “cloud” name tacked onto it, it gets more visibility. I fully agree having redundant architecture, cloud or physical, is core to a successful infrastructure implementation.