TLDR AI · ENGINEERING & RESEARCH

CACTUS NEEDLE

github.comGitHub repository

Summary from the TLDR AI newsletter

Cactus Needle is a 26M parameter Simple Attention Network distilled from Gemini 3.1 that can be finetuned locally on a Mac/PC. It runs on Cactus at 6,000 tokens per second prefill and 1,200 decode speed. The weights are fully open. Simple Attention Networks are aimed at redefining AI for consumer devices like phones, watches, and glasses.