ONE WIDE FEEDFORWARD IS ALL YOU NEED

Summary from the TLDR AI newsletter

The feedforward layers of the transformer make up a significant portion of the total weights in the network. However, if you use a single large feedforward layer shared between the encoder and decoder, you can dramatically improve inference time with minimal drops in performance.