TLDR AI · RESEARCH & INNOVATION

FINE-TUNE LLAMA 3 WITH ORPO

links.tldr.tech13 min read

Summary from the TLDR AI newsletter

While this tune performs worse than Hermes, it is likely due to the small dataset used. Otherwise, this is a great walkthrough on how to tune these models to improve desired performance on certain tasks.