DISTILLING SYSTEM 2 INTO SYSTEM 1

Summary from the TLDR AI newsletter

System 2 models are those that use something like Chain of Thought to spend more test time compute and improve reasoning. It turns out that you can distill this behavior into a System 1 model that runs faster with similar accuracy.