THE ARCHITECTURE OF DROPBOX'S LOAD BALANCING SERVICE

Summary from the TLDR Web Dev newsletter

Dropbox's Robinhood load balancing service improved its hardware utilization, reducing fleet sizes by 25% and saving millions annually. Robinhood operates by collecting load reports from services, using these reports to distribute traffic evenly across servers based on metrics like CPU utilization and geographic location. The performance indicators for Robinhood include max/avg ratio, p95/avg ratio, and p5/avg ratio.