Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

MINIMAX'S HAILUO 02 TOPS GOOGLE VEO 3 IN USER BENCHMARKS AT MUCH LOWER VIDEO COSTS

MiniMax's second-generation video AI model, Hailuo 02, features major upgrades in both performance and price. It uses an architecture called Noise-aware Compute Redistribution that improves training and inference efficiency by a factor of 2.5. The architecture handles long video sequences differently depending on the stage of training. Hailuo 02 has three times more parameters and four times more training data compared to its previous version. A video generated with the model is available in the article.

INFERENCE ECONOMICS OF LANGUAGE MODELS

The first comprehensive model of LLM serving economics reveals why current approaches to scaling inference hit walls faster than expected, as AI companies race to serve token-intensive reasoning models and agents. Network latency, not bandwidth, creates the primary bottleneck that prevents companies from simply adding more GPUs to increase capacity. Algorithmic breakthroughs like speculative decoding, which delivers double the speed at no additional cost, continue to reshape the economic landscape as providers struggle to match surging demand.

COMPILING LLMS INTO A MEGAKERNEL: A PATH TO LOW-LATENCY INFERENCE

Traditional large language model (LLM) systems often rely on sequences of GPU kernel launches and external communications calls, which results in underutilized hardware. This post discusses how a team created a compiler that automatically transforms LLM inference into a single megakernel, which eliminates launch overhead, enables fine-grained software pipelining, and overlaps computation with communication across GPUs. The end-to-end GPU fusion approach reduces LLM inference latency by 1.2 to 6.7 times.

SIX-MONTH-OLD, SOLO-OWNED VIBE CODER BASE44 SELLS TO WIX FOR $80M CASH

Israeli developer Maor Shlomo recently sold his six-month-old, bootstrapped vibe-coding startup, Base44, to Wix for $80 million cash. His eight employees will collectively receive $25 million of the $80 million as a 'retention' bonus. Base44 grew to 250,000 users in six months. It generated $189,000 in profit in May even after covering high LLM token costs. The startup grew mostly through word of mouth.

TLDR IndexPage 3