MAKING AGENTS FAST - WHAT I'VE LEARNT OVER THE LAST 12 MONTHS

Summary from the TLDR newsletter

Knowing what part of inference a project relies on for speed is important. Check thinking budgets, and read traces, as they often contain valuable insight into what an agent wants to do. Give agents the tools they want rather than what you think they need. Faster hardware still matters, sandboxing and microVMs add complexity, parallelization helps, and classic software performance optimization is still relevant.