GOOGLE'S NEW TECHNIQUE GIVES LLMS INFINITE CONTEXT

Summary from the TLDR AI newsletter

Google researchers have introduced Infini-attention, a technique that enables LLMs to work with text of infinite length while keeping memory and compute requirements constant.