CAN AI AUTOMATE EPOCH?

Summary from the TLDR AI newsletter

Epoch Automation Reports show that models can't yet autonomously produce Epoch-quality work. Frontier models performed reliably on well-defined tasks, but they failed in the more open-ended aspects that prevent full automation. Open-weight models lag further behind, struggling even on the well-defined tasks that frontier models handle reliably. The models struggle to pick up Epoch's standards, even with ample reference material, and while they could identify promising research directions, they lacked the judgment to successfully follow through.