Security

The Aftermath of AWS’s DNS Meltdown: Exploring the Impact of This Week’s Outage

Published

5 months ago

October 26, 2025

AWS Outage Caused by DNS Failure

Amazon revealed that a significant DNS failure was the root cause of a massive AWS outage that disrupted numerous websites and online services on Monday.

Reported by BleepinComputer earlier this week, the incident primarily affected a critical data center in Northern Virginia within the US-EAST-1 region, impacting users globally for over 14 hours.

According to a post-mortem analysis released on Thursday, a race condition led to a major DNS failure within Amazon DynamoDB’s infrastructure, specifically within its DNS management system responsible for routing user requests to healthy servers. This resulted in the unintentional deletion of all IP addresses for the database service’s regional endpoint.

“The underlying cause of this issue was a hidden race condition in the DynamoDB DNS management system that caused an incorrect empty DNS record for the service’s regional endpoint (dynamodb.us-east-1.amazonaws.com) that the automation failed to rectify,” stated Amazon.

At 11:48 PM PDT, when the issue occurred, all systems requiring connection to the DynamoDB service in the N. Virginia (us-east-1) Region via the public endpoint started experiencing DNS failures, preventing access to DynamoDB. This affected both customer traffic and internal AWS services relying on DynamoDB.

The DynamoDB failure triggered a series of issues across AWS infrastructure, leaving the DNS system in an inconsistent state that automated recovery processes could not resolve, necessitating manual intervention.

Amazon has globally disabled the faulty DNS automation and implemented measures to prevent similar incidents in the future, such as adding protective checks, enhancing throttling mechanisms, and developing an additional test suite to detect similar bugs.

“We regret the impact of this event on our customers. While we have a strong history of maintaining our services with the highest levels of availability, we understand the critical nature of our services to our customers, their applications, end users, and businesses,” Amazon emphasized.

“We recognize the significant impact this event had on many customers. We are committed to learning from this incident and leveraging it to enhance our availability even further.”