TLDR AI · ENGINEERING & RESEARCH
VISUAL FEATURES ACROSS MODALITIES: SVG AND ASCII ART REVEAL CROSS-MODAL UNDERSTANDING
Summary from the TLDR AI newsletter
Claude's internal neurons can recognize when text forms visual art. The same neuron that fires for the word "eyes" also activates when it sees @ symbols arranged as ASCII eyes or SVG circle elements positioned as eyes within a face. Anthropic researchers found these cross-modal patterns across mouths, ears, dogs, and cats, demonstrating that the model builds associations between concepts and their visual representations across formats, similar to how humans can recognize a smiley face whether it's drawn, described, or coded in SVG.