TLDR AI · ENGINEERING & RESEARCH

MIXTURE-OF-RECURSIONS

arxiv.org23 min read

Summary from the TLDR AI newsletter

DeepMind researchers have introduced Mixture-of-Recursions (MoR), a unified architecture that combines parameter sharing and adaptive computation by using a recursive transformer with lightweight routing.