THE CONTINUAL LEARNING PROBLEM

Summary from the TLDR AI newsletter

Memory layers are a natural architecture for models that are always training and continually learning from experience over time. Finetuning memory layers enables learning without forgetting much more effectively than LoRA. Continual learning and memory is still a huge and rich space to explore. We are only just starting to reach the point where we can imagine what it might look like to have models that learn online in the real world.