RLHF BOOK - POLICY GRADIENTS

Summary from the TLDR AI newsletter

Great chapter on many policy gradient methods like PPO and GRPO, which can be used for tuning generative auto-regressive models.