CODE RELEASED FOR MOE PEFT

Summary from the TLDR AI newsletter

Cohere’s research arm For AI developed parameter efficient fine-tuning for Mixture-of-Experts models. It recently released the code for the community to build on.