TLDR AI · ENGINEERING & RESOURCES
IMPROVED MOE WITH C3PO
Summary from the TLDR AI newsletter
C3PO introduces a new test-time optimization technique that improves accuracy in Mixture-of-Experts LLMs by re-mixing expert weights based on similar reference samples.