TLDR AI · ENGINEERING & RESEARCH

FLEXOLMO: LLM TRAINING WITHOUT SHARING RAW DATA

allenai.org5 min read

Summary from the TLDR AI newsletter

The first of its kind, this architecture allows data contributors to activate or deactivate their contributions in real-time without retraining the entire model, enabling instant modification. The system trains separate expert modules on private datasets using a frozen public model as an anchor point, then merges them via domain-informed routing without requiring joint training.