HOW TO GAME THE METR PLOT

Summary from the TLDR AI newsletter

METR topics are public, making it easy to game METR horizon length measurements for a frontier lab. The horizon length under METR's assumptions might be adding little information beyond benchmark accuracy. There is a meme going around based on a team achieving a one to four hour range on the METR plot. This post explains why the plot has been interpreted incorrectly.