TLDR · PROGRAMMING, DESIGN & DATA SCIENCE

OLLAMA

github.comGitHub repository

Summary from the TLDR newsletter

Ollama allows users to run and package large language models on macOS. It includes a library of open-source models, including Llama2, Orca Mini, Vicuna, and Nous-Hermes. At least 8 GB of RAM is needed to run the 3B models, 16 GB for the 7B models, and 32 GB for the 13B models.