CONTRASTIVE PREFERENCE OPTIMIZATION

Summary from the TLDR AI newsletter

Another preference optimization technique now applied to machine translation. It is more data efficient than DPO on this task. Importantly, the objective discouraged the model from proposing adequate but inaccurate translations, which enabled the model to achieve competitive performance on WMT.