END-TO-END TEST-TIME TRAINING

Summary from the TLDR AI newsletter

E2E is a long-context language modeling approach that reframes the task as continual learning. Using standard Transformers with sliding-window attention, the model learns at test time via next-token prediction and meta-learns during training for better initialization.