TLDR AI · ENGINEERING & RESEARCH
DEEPSEEK-V3.2-EXP: SPARSE ATTENTION MODEL
Summary from the TLDR AI newsletter
DeepSeek-V3.2-Exp has introduced a sparse attention mechanism aimed at improving training and inference efficiency on long-context sequences.