TLDR AI · DEEP DIVES & ANALYSIS

SWARM SCALING

tobyord.com13 min read

Summary from the TLDR AI newsletter

Scaling up the number of agents in a swarm by 10x doesn't get as much performance as using 10x as many tokens with one agent. This shortfall accumulates quickly for larger scale-ups, with the swarm falling further and further behind. However, swarms can theoretically achieve the same task in much less time as they are run in parallel. The speedup is substantial, so swarms are useful in situations where a large premium is paid for speed.