EMULATE TRAINING A LARGE MODEL JUST BY TRAINING A SMALL ONE

Summary from the TLDR AI newsletter

Emulator Fine Tuning (EFT) comes from the direct preference optimization group and explores what happens if you fine tune a small model and then project that fine tuning onto a large model. This counterintuitive strategy works shockingly well.