CLIENT-SIDE LOAD BALANCING AT A MILLION REQUESTS PER SECOND

Summary from the TLDR Dev newsletter

A client-side load balancer was developed to handle over a million requests per second of internal traffic, migrating routing decisions from a shared edge load balancer, Skipper, to improve latency and system resilience while reducing costs. It included features like occupancy-based bounded load and AZ-aware routing strategies to improve performance and efficiency.