TLDR AI · RESEARCH & INNOVATION
FINE-TUNE LLAMA 3 WITH ORPO
Summary from the TLDR AI newsletter
While this tune performs worse than Hermes, it is likely due to the small dataset used. Otherwise, this is a great walkthrough on how to tune these models to improve desired performance on certain tasks.