Back to the archive

The encyclopedia · Software & IT · Technical decision · 2026

Microsoft 365 falls for five hours after a maintenance bug cut West US off the network

A bug in Microsoft's maintenance request layer expanded the change beyond intent, removed IP routes and severed a West US datacenter.

Microsoft · 2026-07-23

What happened

On July 23 2026, Microsoft 365 and a broad slice of Azure went down for nearly five hours, from 10:44 a.m. to 3:41 p.m. ET, in incident MO1437424. Teams, SharePoint Online, OneDrive, the Admin Center, Power Automate, Copilot Chat and Loop all degraded, alongside Azure App Service, Application Gateway, Cosmos DB, AKS, ExpressRoute, Virtual WAN and more.

The root cause was a decision encoded in automation. A software layer translates human maintenance requests into machine-readable instructions, and a bug in that conversion incorrectly marked additional network devices as part of the maintenance scope. The result removed IP routes from more devices than were authorized, severing a West US datacenter from the WAN.

The failure survived Microsoft's own safety gate: the check evaluated the buggy conversion's output rather than the engineers' original intent, so it validated the wrong scope and passed. Users filed 2,403 Downdetector reports — 83 times the baseline of 29 — and at least 19 downstream SaaS services fell with cascading outages, 16 of which were still open after Microsoft announced recovery.

The incident capped a poor quarter: Microsoft 365 delivered 99.526% uptime in Q1 2026, the lowest since reporting began in 2013. The most telling gap was not the bug but the safety check, which verified what the machine produced instead of what the human meant — an automation failure that no checklist caught.

Why it happened

  • Microsoft automated maintenance request translation, and a bug in the conversion layer silently expanded the change scope
  • The safety check validated the buggy output instead of the engineers' intent, so the wrong scope passed as correct
  • Removing IP routes from unauthorized devices severed a whole West US datacenter from the WAN
  • The near-five-hour outage cascaded into 19 downstream SaaS outages, 16 still open after Microsoft's fix
What it cost5-hour outage of 365 and Azure, 19 downstream services hitcostly

The lesson

A safety check that verifies a machine's output against that same machine's translation ratifies the bug — automation must be checked against human intent, not against its own expanded scope.

Sources

spotted an error? The club wants to know.

Comments · 0

    Sign in to join the comments.

    More like this

    Somewhere, someone solved the problem this company failed at. 2nd Opinion →