Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

GENERAL

TLDR AI

MUSK'S SPACEXAI CONSIDERS OVERHAUL OF PRICING FOR GROK, X USERS

SpaceX is considering an overhaul of its subscription pricing options for Grok and X. It plans to soon offer a unified subscription for the services with four pricing tiers. The options will range from a free offering with stricter usage limits for its Grok chatbot to a $100 per month Ultra tier that includes access to the Grok Bot AI agent. The $8 per month 'lite' plan will include access to Grok, a verified checkmark, and fewer ads on X.

WE CAN AND MUST SOLVE ALIGNMENT

The Goodfire team identifies interpretability as the main challenge in AI alignment, highlighting its critical role in understanding and controlling AI behaviors. They stress the urgency of developing and deploying tools for detecting, debugging, and designing AI systems, focusing on controlling generalization and verifying what models learn. As AI models advance, they seek breakthroughs in interpretability to ensure safe and reliable AI alignment, advocating for a collective effort among the tech community.

DEEPSEEK BUILDS FOR HUAWEI ASCEND

DeepSeek plans to start rebuilding the software ecosystem around Nvidia's hardware so that Chinese chips become genuinely easier to use and capable of training frontier AI models. Nvidia's CUDA ecosystem provides developers with a mature set of tools for writing programs, optimizing performance, and getting thousands of GPUs to work together efficiently. DeepSeek is trying to create a layer of abstraction between models and the underlying GPU hardware that could potentially sit on top of either Nvidia GPUs or Huawei Ascend chips. If all goes well, the cost and difficulty of moving AI workloads from Nvidia to Chinese AI hardware could fall significantly.

GENERALIZATION DYNAMICS OF LM PRE-TRAINING

During pre-training, models can abruptly switch response patterns, a phenomenon termed MODE-HOPPING. Tests reveal this behavior in OLMo3-32B during arithmetic tasks, showing sudden shifts between pattern-following and correct task inference as training progresses. Controlled experiments suggest competing shallow and generalizable circuits within models, revealing that longer training doesn't always guarantee better generalization.

A NEW TRANSFORMER PASSES ITS HIDDEN STATE TO THE NEXT TOKEN INSTEAD OF RECOMPUTING IT

Researchers built LIFT, a transformer that feeds its internal state back into the next generation step instead of squeezing everything through the single token it outputs. Training stays parallel because the states come precomputed from an off-the-shelf model's next-token predictions, while at inference the model feeds back its own. LIFT models from 135M to 1B parameters beat token-matched standard transformers on language modeling, reasoning, and procedural tasks, so the next question is whether the gains hold at frontier scale.

TLDR IndexPage 3