LLMS ARE COMPLICATED NOW

Summary from the TLDR AI newsletter

Attention might be all you need, but modern models use many different variants of it.