Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

NVIDIA-BACKED STARTUP SEEKING TO COUNTER CHINESE AI EYES $25 BILLION VALUATION

Reflection is a startup leading an effort to create freely available US AI systems. It is one of a handful of Nvidia-linked startups seeking to build a network of open source AI models. The startup is in talks to raise $2.5 billion at a valuation of $25 billion. Investors describe Reflection as the 'DeepSeek of the West' as it offers an alternative to the open source models offered by Chinese companies.

LEADERS OF AI FIRM BOUGHT BY META ARE RESTRICTED FROM LEAVING CHINA

Manus' co-founders, Xiao Hong and Ji Yichao, have been told not to leave China while authorities review the company's $2.5 billion sale to Meta. Early versions of Manus were created by engineers from a Chinese company. A Singapore-based entity then took over Manus' operations and relocated most of its China-based employees to Singapore, which made it possible for Meta to purchase it. Authorities are concerned that Manus' moves could encourage other Chinese companies to follow suit and move out of the country without vetting.

CLOSED SOURCE VS OPEN SOURCE AI: A CAGE FIGHT FEW PEOPLE UNDERSTAND

Open source models are reaching parity with frontier labs' models, making those labs' equity look overpriced if they're simply utilities. These frontier labs have enterprise agreements, safety certifications, distribution, research talent, and regulatory positioning, but that doesn't explain their moat. People focus on capability, but the number that actually matters for valuations is the monetizable spread, the subset of that capability delta that someone will actually pay a premium for. The monetizable spread is declining faster than the capability spread.

QUANTIZATION FROM THE GROUND UP

Quantized models are actually pretty good. A 16-bit to 8-bit quantization carries almost no quality penalty - the difference with a 4-bit quantization is more noticeable, but it would only perform about 90% as well as the original. It's worth experimenting with these models as they're much smaller and can run on more systems. This article explains how model parameters work, what quantization is, how quantization is applied in practice, and the effects of quantization on model accuracy.

FINAL TRAINING RUNS ACCOUNT FOR A MINORITY OF R&D COMPUTE SPENDING

The final training run for a model is only the last step in a long, expensive process. Before the run, companies burn compute on running experiments at various scales, generating synthetic data, testing ideas, and training unreleased models. The full cost of developing a model is much higher than the cost of the final training run of a frontier model. Most of the spend is on exploration rather than execution. Companies that learn from their competition can replicate their results for a fraction of the original cost.

WHAT HAPPENED WHEN I APPLIED KARPATHY'S AUTORESEARCH IDEA TO LLM INFERENCE

Manthan Gupta built Auto-Inference-Optimiser to let an AI agent hill-climb on LLM inference speed while keeping quality fixed on Apple Silicon. Argmax sampling and simplifying inference code gave the largest throughput gains, while most tuning knobs and KV cache quantization hurt or had no effect. The project highlights that a disciplined, observable harness is critical for distinguishing real performance wins from noise or benchmark illusions.

INSIDE THE GRIND: THE SF STARTUP RACING TO BUILD AN AI SOFTWARE ENGINEER

Cognition's Devin is an AI software engineer that can build software from start to finish without human involvement. When it launched in 2024, it was considered a step toward a long-held Silicon Valley dream of a machine that codes for you. Cognition's CEO, Scott Wu, believes that the technology doesn't mean the end of software engineering. Rather than eliminate engineers, Cognition's tools will allow them to focus on the best parts of the job while sparing them from the grunt work that traditionally consumes most of their time.

TLDR IndexPage 3