TLDR AI · ENGINEERING & RESOURCES
WANDA: A NEW PRUNING METHOD FOR LARGE LANGUAGE MODELS
Summary from the TLDR AI newsletter
The repo presents Wanda, a unique method for reducing the complexity of large language models by selectively dropping less significant network weights. Unlike other methods, Wanda doesn't require retraining or intensive computation, providing effective model pruning while maintaining performance.