TLDR AI · MISCELLANEOUS

RUNNING LLMS LOCALLY WITH OLLAMA

erichartford.com4 min read

Summary from the TLDR AI newsletter

Ollama is like a package manager around llama cpp models. It has quality-of-life usability features and makes it easy to run models, even on a CPU. This example shows how to run two great models, Dolphin and Samantha, which are excellent unfiltered models useful for conversational tasks.