HOW TO SCALE RL TO 10^26 FLOPS

Summary from the TLDR AI newsletter

Reinforcement learning is the next training technique for building frontier-level AI models. Training it on more data will make it better. The current approach of scaling is messy and complicated. Finding a way to do next-token prediction on the web using RL would enable models to reason from general web data instead of just math and code.