TRANSFORMERS LEARN TO SOLVE COMPLEX ARITHMETIC WITH NEW EMBEDDINGS

Summary from the TLDR AI newsletter

Researchers have improved transformer performance on arithmetic tasks by adding embeddings that encode each digit's position relative to the start of the number.