MODULAR POST-TRAINING

Summary from the TLDR AI newsletter

AllenAI describes a post-training approach that builds independent domain experts and combines them using a mixture-of-experts architecture. This allows models to gain new capabilities without retraining from scratch or degrading existing skills.