TLDR AI · ENGINEERING & RESOURCES
EXLLAMAV2
Summary from the TLDR AI newsletter
An inference library for running local LLMs on modern consumer GPUs.
TLDR AI · ENGINEERING & RESOURCES
An inference library for running local LLMs on modern consumer GPUs.