TLDR AI · RESEARCH & INNOVATION
TRAINING LANGUAGE MODELS TO SELF-CORRECT VIA REINFORCEMENT LEARNING
Summary from the TLDR AI newsletter
Deepmind has released a paper that shows promise, even if the actual results aren't state-of-the-art. It shows a reinforcement learning paradigm that can be used to help models self-correct when generating math and code.