TLDR AI · RESEARCH & INNOVATION
EFFICIENT COMPRESSION FOR MOE MODELS
Summary from the TLDR AI newsletter
C-Prune is a two-stage pruning method that compresses Mixture-of-Experts models by clustering similar experts and pruning redundant clusters.
TLDR AI · RESEARCH & INNOVATION
C-Prune is a two-stage pruning method that compresses Mixture-of-Experts models by clustering similar experts and pruning redundant clusters.