CONTINUAL LEARNING WITH ONLINE-LORA

Summary from the TLDR AI newsletter

Online-LoRA is a new framework designed to prevent catastrophic forgetting in online continual learning (OCL) by fine-tuning pre-trained Vision Transformers (ViTs) in real time without needing rehearsal buffers.