TLDR AI · RESEARCH & INNOVATION

CRAMMING 1568 TOKENS INTO A SINGLE VECTOR

arxiv.org18 min read

Summary from the TLDR AI newsletter

This work explores the limits of representational capacity by attempting to fit as many tokens as possible into a single fixed size embedding vector.