WHY MACHINE LEARNING RESEARCH AGENTS DON'T OVERFIT, AND WHAT COMPRESSION HAS TO DO WITH IT

Summary from the TLDR Dev newsletter

Successful research strategies often survive an extreme information bottleneck, suggesting that they capture real structure instead of memorizing validation data. Across eight datasets, fresh agents reproduced most results from prompts as short as 32 tokens, while deliberately overfit gains disappeared after compression.