TLDR AI · ENGINEERING & RESOURCES
OPENRLHF
Summary from the TLDR AI newsletter
This is a Ray-based implementation of RLHF for Llama-style models, which includes Mistral. It contains a number of PPO stabilization tricks to improve performance.
TLDR AI · ENGINEERING & RESOURCES
This is a Ray-based implementation of RLHF for Llama-style models, which includes Mistral. It contains a number of PPO stabilization tricks to improve performance.