TLDR AI · RESEARCH & INNOVATION

LOCAL MODELS AS MINIONS

hazyresearch.stanford.edu18 min read

Summary from the TLDR AI newsletter

Hazy Research has found that if you use local models via Ollama and use a long context cloud model as the orchestrator, you can achieve 97% task performance at 17% of the cost.