TLDR AI · RESEARCH & INNOVATION
LLM QUANTIZATION: A COMPREHENSIVE STUDY
Summary from the TLDR AI newsletter
Post-training quantization can make large language models like OPT and LLaMA2 more memory- and compute-efficient.
TLDR AI · RESEARCH & INNOVATION
Post-training quantization can make large language models like OPT and LLaMA2 more memory- and compute-efficient.