Trade on tv
NewsAI
negative
Guardian Business14h agoUKTECHNOLOGY

Microsoft identifies months-old bug as root cause of global outage

2 min read7% importance330 words
G

Guardian Business

Guardian Business

Microsoft has identified the root cause of the outage on Thursday that crippled Outlook, Exchange and a host of other vital office software across the globe.

The company issued an initial report on Monday that identified a months-old bug malfunctioning connections between internal systems as the factors that led to the 24-hour blackout of Microsoft services. Each of these factors may have easily been resolved on their own but, together, led to a major outage that was harder to mitigate, company executives said.

The disruption began Thursday with US users reporting interrupted access to their Outlook email accounts. As it continued into the next day, millions of people worldwide said they could not access their email in any capacity as well as other Office 365 services. Jails could not release prisoners, hospitals turned to paper records, schools lost contact with parents, and police departments could not receive crime reports. Microsoft said it had resolved the issue and restored service by Saturday, also issuing an apology. The company did not attribute the blackout to a cybersecurity breach.

In a post on X on Monday, Charles Lamanna, the executive vice-president of Copilot, Agents, and Platform at Microsoft, said there was a latent bug or defect from July that caused Microsoft’s servers to “become overwhelmed and unresponsive”.

Lamanna wrote that the company typically has two available networking gateways, or entry and exit points that connect separate systems and allow data to pass between them. However, one of them was not working for Microsoft Teams which overwhelmed the primary gateway. Subsequently, over 14% of the company’s server capacity was also not working due to an unrelated issue from the previous day.

“Taken together, the increased load and the reduced server capacity, caused the network gateway to encounter the latent bug from July,” Lamanna wrote. “This caused requests to build up until servers ultimately stopped responding. This occurred during the peak window of traffic in the United States.”

The company also had trouble mitigating the bug because it originated months before, Lamanna said, so it would not be easy as rolling back a recent change to undo the defect.

“Recovery took longer than usual because as servers returned to service, they were immediately overwhelmed by waiting traffic and became unresponsive again,” he wrote. “Our normally automated recovery processes were not designed to restore service from this broad unresponsive state. Additionally, since the main code defect was a latent bug from several months previous, our normal rollback, flighting, and feature flags were unable to quickly revert the change.”

The company plans to publish a final report which will include more information, he said.

Analysts say Microsoft’s global outage highlights the need for companies to examine how much they rely on a single operating system.

AI Summary

Microsoft identified a latent bug from July as the root cause of a 24-hour global outage that crippled Outlook, Exchange, and other Office 365 services. The disruption began Thursday when US users reported interrupted email access, escalating worldwide as millions lost access to email and Office services. Jails could not release prisoners, hospitals turned to paper records, schools lost contact with parents, and police departments could not receive crime reports. Microsoft restored service by Saturday and said it was not a cybersecurity breach.

Sentiment analysis

NEGATIVEscore -0.50 · medium

    AI insights

    Newsworthiness7%
    Global impact7%
    Urgency

    low

    Freshness

    14h ago

    Audience

    general

    Follow-up

    Related categories
    Business

    Financial analysis

    Relevance

    medium

    Market sensitivity

    medium

    Affected sectors

    technology

    Affected assets

      Follow this story on TV

      Live charts and AI commentary on one screen with Trade on tv.

      Explore features