Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

OPENAI IS GOOD AT DEALS

Whenever OpenAI announces a big partnership with a public company, that company's stock will go up. OpenAI is using that stock value to subsidize deals. Its deal with AMD involves OpenAI receiving warrants for up to 160 million AMD shares at 1 cent per share, awarded in phases if OpenAI hits certain milestones for deployment. AMD's stock price also has to increase for the warrants to be exercised. While OpenAI is not publicly traded, it is increasingly making waves in the stock market.

WHY CAN'T TRANSFORMERS LEARN MULTIPLICATION? REVERSE-ENGINEERING REVEALS LONG-RANGE DEPENDENCY PITFALLS

Researchers reverse-engineered why language models fail at simple 4×4 multiplication and found successful models naturally built tree-like attention patterns that "cache" intermediate calculations then retrieve them later, like jotting down a thought on scratch paper. Standard training fails because models learn the easy outer digits first, but get stuck on the middle digits. By adding a simple auxiliary loss that forces the model to predict running totals at each step, models dramatically improve.

TLDR IndexPage 3