AI LEADERBOARDS ARE NO LONGER USEFUL. IT'S TIME TO SWITCH TO PARETO CURVES

Summary from the TLDR Web Dev newsletter

Current AI leaderboards aren't useful anymore because they don't account for the cost of running AI agents. Researchers should instead use Pareto curves to visualize the tradeoff between accuracy and cost. Surprisingly, simple baseline agents can be just as accurate as the complex, costly agents that top leaderboards.