CUTTING LORA REDUNDANCY

Summary from the TLDR AI newsletter

SeLoRA re‑parameterizes LoRA adapters in a sparse spectral subspace, trimming redundant parameters without sacrificing expressiveness and boosting accuracy on commonsense, math, and code generation tasks.