Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

GPT-5 HANDS-ON: WELCOME TO THE STONE AGE

GPT-5 marks the "stone age" for AI. It doesn't just use tools - it thinks with them, like humans first learning to shape stones changed everything. Testing showed it one-shotted dependency conflicts that stumped every other model by using yarn commands like Deep Research uses web search, iterating and reasoning through problems instead of just guessing. While it's worse at writing than GPT-4.5 (producing more "LinkedIn slop"), it's unequivocally the best coding model - creating entire production-ready websites with SQLite databases in one shot, where other models gave scaffolding or plans, automating software engineering from maybe 65% to 72% in one leap.

ACHIEVING 10,000X TRAINING DATA REDUCTION WITH HIGH-FIDELITY LABELS

Identifying policy-violating content requires solutions capable of deep contextual and cultural understanding, an area that large language models (LLMs) excel at over traditional machine learning systems. However, fine-tuning models for such complex tasks requires high-fidelity training data that is difficult and expensive to curate at the necessary quality and scale. This post describes a scalable curation process for active learning that drastically reduces the amount of training data needed for fine-tuning LLMs while significantly improving model alignment with human experts. In experiments, the process reduced the scale of training data needed from 100,000 to under 500 training examples while increasing model alignment with human experts by up to 65%.

FROM HARD REFUSALS TO SAFE-COMPLETIONS: TOWARD OUTPUT-CENTRIC SAFETY TRAINING

The technique uses two reward parameters during training: safety constraints that penalize policy violations by severity, and helpfulness maximization that rewards both direct compliance and informative refusals with safe alternatives. In tests, GPT-5 with safe-completions achieved higher safety scores than o3 on dual-use prompts while providing substantially more helpful responses, and when failures did occur, they were significantly less severe.

TLDR IndexPage 3