TLDR AI · RESEARCH & INNOVATION
LOCAL MODELS AS MINIONS
Summary from the TLDR AI newsletter
Hazy Research has found that if you use local models via Ollama and use a long context cloud model as the orchestrator, you can achieve 97% task performance at 17% of the cost.