TLDR DevOps · OPINIONS & TUTORIALS

HOW UBER PROTECTS AGAINST RETRY STORMS

uber.com12 min read

Summary from the TLDR DevOps newsletter

Uber added error ownership to its shared service-mesh infrastructure, so upstream services can distinguish failures they caused from errors merely propagated from deeper dependencies. During a major outage, the mechanism prevented an estimated 9.5 million unnecessary retry requests and reduced the maximum retry-storm radius across user-facing APIs from as high as 25 hops to 3.