GEMMA 10M CONTEXT

Summary from the TLDR AI newsletter

Discussion of the various ways to extend context for language models. It doesn't provide much in the way of evaluations, but it's a fascinating discussion of where the field is exploring.