TLDR AI · MISCELLANEOUS
RUNNING LLMS LOCALLY WITH OLLAMA
Summary from the TLDR AI newsletter
Ollama is like a package manager around llama cpp models. It has quality-of-life usability features and makes it easy to run models, even on a CPU. This example shows how to run two great models, Dolphin and Samantha, which are excellent unfiltered models useful for conversational tasks.