FORMER OPENAI SAFETY RESEARCHER EXPLAINS AI REASONING REVOLUTION

Summary from the TLDR AI newsletter

Lilian Weng published a comprehensive technical survey connecting test-time compute to human psychology, drawing on Kahneman's "fast vs slow thinking" to explain why models perform better when given extra computational steps before answering. The review covers the science behind chain-of-thought, the RL approaches powering o1 and R1, and the alignment risks posed by reward hacking.