TLDR AI · RESEARCH & INNOVATION

MATRIX MULTIPLICATION ONLY USING ADDITION

arxiv.org21 min read

Summary from the TLDR AI newsletter

Much of modern AI relies on large matrix multiplications. When implemented in hardware, this means there are expensive multiply components on the chips. If we could use cheap additions instead, we could fit more transistors on the chip and potentially run with much less power. This is very early research, but the algorithm presented suggests we can use just additions for large matrix multiplications.