TLDR AI · ENGINEERING & RESEARCH
CACTUS NEEDLE
Summary from the TLDR AI newsletter
Cactus Needle is a 26M parameter Simple Attention Network distilled from Gemini 3.1 that can be finetuned locally on a Mac/PC. It runs on Cactus at 6,000 tokens per second prefill and 1,200 decode speed. The weights are fully open. Simple Attention Networks are aimed at redefining AI for consumer devices like phones, watches, and glasses.