TLDR AI · RESEARCH & INNOVATION
IMBUE TRAINS 70B THAT MATCHES GPT-4
Summary from the TLDR AI newsletter
Imbue has trained and released an extremely powerful 70B language model. It uses Imbue's custom optimizer and some great data filtering techniques. The model was trained with zero loss spikes.