IS THERE A HALF-LIFE FOR THE SUCCESS RATES OF AI AGENTS?

Summary from the TLDR Web Dev newsletter

AI agent performance can be characterized by a "half-life" related to human task completion time. There is an observed exponential decline in success rates with task length and the model proposed in this article allows for predictions of success rates at different task lengths and improvement over time.