SELF ADAPTIVE LANGUAGE MODELS

Summary from the TLDR AI newsletter

Sakana AI has released research and code for training language models that are adaptive during test time. This means that they can perform weight updates and learn while being run at inference.