DPO ON LLAMA 2

Summary from the TLDR AI newsletter

Human feedback is key to improving language model alignment and overall performance. However, the process of training with Proximal Policy Optimization has some challenges. Recent work showed that you can optimize directly against human preference and bypass the reward model. With Text-based Reinforcement Learning, you can do this on state-of-the-art open models.