TLDR AI · RESEARCH & INNOVATION

IMBUE TRAINS 70B THAT MATCHES GPT-4

imbue.com18 min read

Summary from the TLDR AI newsletter

Imbue has trained and released an extremely powerful 70B language model. It uses Imbue's custom optimizer and some great data filtering techniques. The model was trained with zero loss spikes.