Game is down since 11:10am PDT. We have top men working on the problem! Update soon.
[Update 3/11 12:20pm PDT] Games are back, we apologize for the inconvenience. More information will be made available after a root cause analysis on Monday.
[Update 3/12 5:30pm PDT] We had what appears to be a run away query in one of our databases, a cascading failure occurred that caused many new processes to spawn. Eventually exhausting middleware applications out of resources. Over the weekend, we ran profiling on our databases, that pinpointed some specific queries and uncovered some hotspots that we dealt with Sunday/Today.
This was not the same type of failure we had experienced previously with cache servers but the net result was the same, downtime for you the player, and reset rivals lists and game feed history lost. The rivals will be moved into persistent storage this week, downtime will no longer result in resets for this. Please see this past Friday's TGIF dev post.
Thanks for your patience.
Last edited: Mar 13, 2012
