TLDR AI · ENGINEERING & RESEARCH
EFFICIENT LLM DISTILLATION
Summary from the TLDR AI newsletter
MiniPLM is a new framework designed to enhance pre-training of small language models using knowledge from larger models.
TLDR AI · ENGINEERING & RESEARCH
MiniPLM is a new framework designed to enhance pre-training of small language models using knowledge from larger models.