System Update Led to BlackBerry Outage

[Hum]

NEW YORK (AP) -- BlackBerry maker Research in Motion Ltd. said an insufficiently tested software update at the company's network data center was the cause of a service outage this week that left millions of users without wireless e-mail access.

In a statement late Thursday, the company said the outage from Tuesday evening into Wednesday morning was triggered by ''the introduction of a new, non-critical system routine'' designed to optimize the cache, or temporary holding space, of the system that handles e-mail sent to BlackBerry users.

RIM said it didn't expect the update to impact users, ''but the pre-testing of the system routine proved to be insufficient.''

The Waterloo, Ontario-based company also said the process designed to maintain service in the event of a failure ''did not fully perform to RIM's expectations,'' causing a longer delay before service was restored.

RIM said it ruled out security and capacity issues, along with hardware failure or core software issues, as the cause of the disruption and is improving its testing, monitoring and recovery processes to prevent such an outage from happening again.

The problem occurred at RIM's hub for North American traffic, which routes messages to and from cellular service providers for the roughly 8 million BlackBerry devices now in use.

Many people rely heavily on the devices as a lifeline when they're away from their computers. Even more have simply become accustomed to -- and often obsessive about -- being able to check their e-mail at night and on weekends.

source

[markwolfe Veteran]

Well, that's RIM's spin...

The truth is, software updates (even if it is truly bad software) is rarely the cause of major problems like this. The problem comes down to poor administration - untested (or insufficiently-tested) software installed without regard to a fall-back plan on mission-critical equipment. They came out and said it wasn't tested very well, but still shuffle enough blame onto the software to leave people thinking exactly as the title says: "System Update" as the cause.

Someone should lose a job over there (and no, I am not an upset Blackberry user; I have no RIM products).

[Quillz]

Maybe it was good the network went down, then. Gave people a chance to realize they don't need to check e-mail 24/7. They have lives outside of work.