ATTENTION WASN'T ALL WE NEEDED

Summary from the TLDR AI newsletter

A lot of modern techniques have been developed since the original 'Attention Is All You Need' paper. This article looks at some of the most important ones developed over the years and tries to implement the basic ideas as succinctly as possible using the Pytorch framework.