TLDR AI · RESEARCH & INNOVATION

DEEPSCALER: SURPASSING O1-PREVIEW WITH A 1.5B MODEL BY SCALING RL

links.tldrnewsletter.com14 min read

Summary from the TLDR AI newsletter

Most of the research that makes such dramatic claims is easily falsifiable. This is a unique work in that the methods are quite sound. One cool finding the researchers made is that by gradually increasing the context length during RL training, they could smoothly improve AIME performance without wasting compute.