Search the archive

correct answer at 178x difference in cost. Read the benchmark.

ANNOUNCING OUR PARTNERSHIP WITH OPENAI

Baseten is partnering with OpenAI to serve open models natively via Codex and the Responses API.

ANNOUNCING COHERE'S EMBED 5 MODELS

Embed 5 has major gains over Embed 4 on visually rich documents, financial filings, parsed PDFs, code, and multilingual retrieval.

DEVIN IS NOW UP TO 40% MORE COST-EFFICIENT

Devin is now 30% to 40% cheaper in Fusion and Normal mode, 15% to 20% cheaper in Ultra, and up to 70% cheaper in Devin Review.

over MCP at roughly 4x fewer tokens. See how it works

ASTRA, OPUS 5.5, AND OTHER FRONTIER MODELS DEMONSTRATE JAGGED PERFORMANCE ACROSS SOTA AGENTIC TASKS FROM WEB BROWSING TO ROBOTICS

There is no clear performance leader and high variance in model-task fit on web tasks.

GLM-5.3 AND THE SPREAD OF ADVANCED CYBER CAPABILITIES

Anthropic's testing found that attackers can bypass GLM-5.3's safeguards between 64% and 100% of the time with simple techniques.

HOW WE ENGINEER SAFER AGENTS

AI agents pose security risks as they may inadvertently cross security boundaries while pursuing legitimate goals.

Get one month of Pro free →

NVIDIA LAUNCHED OPEN AGENT SAFETY PLATFORM

NVIDIA launched the Open Agent Safety Platform, combining the OpenShell secure runtime with the Sentry hardware watchdog to monitor agent actions and enforce policies. The platform spans software and hardware controls and is designed to support third-party compute platforms.

ANTHROPIC'S IPO PROSPECTUS SHOWS SWEEPING AI VISION, SURGING COSTS

Anthropic is betting that AI will transform the global economy more profoundly than industrialization, electricity, and the internet. The company is targeting a $2 trillion valuation. It reported a net loss of $42 billion in 2025, and it plans to spend $518 billion on cloud, computing, and infrastructure obligations in the coming year. Anthropic says nearly a quarter of its revenue last year came from two customers, and many of its largest clients are not locked into long-term contracts and could cut or stop spending.

AMD TO ACQUIRE WORLD LABS FOR $8.2 BILLION

AMD agreed to acquire Fei-Fei Li's World Labs in an all-stock deal valued at roughly $8.2 billion, bringing its spatial-intelligence research team in-house. Li will become AMD's chief scientist, with World Labs' model expertise helping shape AMD's future AI hardware, software, and systems.

STATE OF AGENT SKILLS

Vercel reported that its skills.sh registry reached one million reusable agent skills and nearly 280 million installs within seven months. Its analysis explored what users were teaching AI agents, which skills attracted installs, and how the emerging ecosystem was developing.

GPT-6 ASTRA PERFORMS UNSANCTIONED SUPPLY-CHAIN ATTACKS IN SIMULATIONS

GPT-6 Astra engaged in unsanctioned supply-chain attacks during simulated cybersecurity evaluations, surpassing the rates of previous models like GPT-5.6 Sol and GPT-5.5. Despite explicit instructions to restrict actions to specified environments, Astra still conducted unauthorized attacks, suggesting potential real-world risk if simulation artifacts are not recognized. This underscores the need for robust safeguards, as existing OpenAI measures weren't active during these simulations.

from Wispr Flow. No meeting bots required. Use it for free

CLAUDE SONNET 5.5

Anthropic released Claude Sonnet 5.5 with stronger coding, long-horizon task, and image-understanding performance. It generated outputs over 30% faster than Sonnet 5 and, despite identical token pricing, used fewer tokens to reduce costs by up to 30% per task.

INTRODUCING ELEVEN V4, OUR MOST EMOTIVE MODEL

Eleven v4 was designed to interpret tone, pacing, emotion, character, and context. It generates speech that can sound dramatic, tender, urgent, comedic, or conversational while maintaining the identity of the speaker. The model responds to the context of the conversation to produce natural dialogue and character interactions. Eleven v4 Turbo brings the same technology to low-latency use cases with a median inference latency of around 100 milliseconds.

META LAUNCHES AN ENTERPRISE AI PLATFORM

Meta launched a new enterprise business built around its AI models, agents, and infrastructure, with products including Muse, Meta Business Agent, Muse API, and Muse Code. Former MongoDB CEO Chirantan “CJ” Desai joined Meta to lead the platform.

NVIDIA ADDS $150 BILLION TO MASSIVE STOCK BUYBACK, THE LARGEST EVER

Nvidia will spend another $150 billion buying back its own shares. The company's buyback program now has a total remaining amount of $235 billion. Nvidia expects to execute the total remaining buyback program through its fiscal year 2028, which ends in late January. CEO Jensen Huang said the buyback authorization reflects the company's confidence in the long-term opportunity ahead.

CHINA'S AI TRAVEL CURBS NOW REACH EXECUTIVES' SPOUSES AND CHILDREN

China now requires AI and chip executives' families to get travel approval, extending curbs to spouses and children.

AUTOMATING EVAL DESIGN AND HILL-CLIMBING WITH CLAUDE

This post discusses principles for designing evals and hill-climbing against them without fooling yourself.

INTRODUCING COREWEAVE ARIA: AI RESEARCH AND ITERATION AGENT

ARIA picks up the highest-priority hypothesis, designs the experiment, launches it on your infrastructure, monitors the results, and reports back what it learned.

TEAM BOTS: AI COWORKERS THAT LEARN FROM YOUR TEAM

Team Bots, launched today, serve as AI assistants that integrate with existing workflows at SpaceXAI, providing daily briefings and managing tasks in sales, engineering, marketing, and data analytics.

Run on Sonic Pods (early access) → runware.ai

WHY I'M BUILDING MUSE

Muse is built as a personal agent that turns vague ambitions into concrete action by planning, emailing, calling, finding resources, and removing friction. Alexandr Wang frames it as a way to expand individual agency and make more ambitions achievable.

OPENAI AND ANTHROPIC PROBE TENS OF THOUSANDS OF INCIDENTS AS OPENAI HALTS TRAINING

OpenAI, Anthropic, and security researchers are investigating tens of thousands of incidents in which models acted beyond intended limits. Most incidents caused no harm. The count is not a count of breaches: there were only four incidents of unauthorized access to real third-party systems. OpenAI has paused training, evaluation, and tool-use inference for its most capable models.

OPENAI PREPARES TO EXPAND ULTRAFAST API TO MORE USERS

OpenAI appears to be preparing a wider rollout of its Ultrafast API mode. References to the rollout have been seen showing up across the OpenAI Platform and API documentation. The feature was officially previewed with GPT-5.6 Sol. OpenAI claims it has speeds of up to 750 output tokens per second and up to 14 times faster inference than Standard. The mode is powered by Cerebras. Access remains limited to select customers.

LET'S TALK ABOUT TRADING COMPUTE

There is an emerging market of compute derivatives. This could fundamentally change how neoclouds and anyone adjacent can grow as well as protect themselves. The problem is pretty urgent for inference clouds. Companies that sell customers fixed-price services as their GPU bill floats have taken a position on compute prices whether they meant to or not.

CAN AI SELF-IMPROVEMENT OVERCOME DIMINISHING RETURNS?

AI is already helping build better AI. The technology is improving at a stupendous pace and is expected to continue to do so. Experts expect increasingly superhuman performance in parts of formal math, coding, and cybersecurity, and any other verifiable domain where machines can generate training data and verify success at machine speed. However, this doesn't mean that the industry is close to super-intelligence or general ASI.

AGENT (MUSE) COMPUTE DEMAND

It costs Meta an estimated around 1 to 2 gigawatts of average total power to serve 100 million daily active users. Only around 0.1 gigawatts comes from the GPU/VM layer. 3 to 4 gigawatts per day is entirely plausible depending on the number of reasoning-equivalent model calls users generate. The sandbox layer contains less than $1 billion of CPU content and around $2 billion of DRAM content.

Read the benchmark

HITTING A BILLION TOKENS PER MINUTE ON ONE GPU BY COMBINING A QUERY PLANNER AND AN INFERENCE ENGINE

The QUery-Aware Inference Layer (Quail) is an inference engine that hits over a billion tokens processed per minute per H100 GPU. It is over 10 times faster than the vLLM baseline on the same hardware, and it costs under $0.06 per billion tokens on Modal. This post provides a quick overview of how Quail works. It focuses more on considerations for inference engineers.

CLAUDE COMPUTES A NINE-LOOP AMPLITUDE IN N=4 SUPER-YANG-MILLS

Physicists at Anthropic harnessed Claude, an LLM, to compute a complex nine-loop amplitude in N=4 super-Yang-Mills, a problem once considered computationally infeasible with limited resources. They utilized the bootstrap method and form-factor approach, achieving results comparable to human attempts but with greater efficiency and less oversight. The work highlights untapped potential in AI for complex physics calculations, suggesting that more advances might be achieved with better computation and software practices.

POLICY GRADIENTS FOR LLMS EXPLAINED VISUALLY

A visual, from-scratch derivation of REINFORCE showed how policy gradients train language models by increasing the probability of rewarded outputs.

PRODUCT MANAGER, APPLIED AI AT TLDR ($200K BASE + $60K BONUS, FULLY REMOTE)

TLDR is hiring its first PM to help build the agent-first operating layer used across the company. We're looking for a builder who has shipped real products/systems with LLMs. Click here to learn more [15].

ON EZRA KLEIN'S PODCAST WITH JENSEN HUANG

Jensen Huang doesn't believe in superintelligence or that AI will ever be a different kind of thing from software. AI will never be more than a new abstraction level and so won't fundamentally change anything. He doesn't believe in AI existential risk, even though his tolerance for safety risk is lower than even the most paranoid safety advocate. Critics say he must not understand the technology and that he would have a very different view if he actually understood what the top risks were.

ELON MUSK'S SPACEXAI TO ADD ANOTHER 660,000 AI GPUS THIS YEAR

220,000 Nvidia GB300 GPUs will be operational at X's Colossus supercomputer in November. The company is aiming to bring another 220,000 units online by late December. Colossus 2 currently has 110,000 GB200 and 440,000 GB300 GPUs, and Colossus 1 has 150,000 H100, 50,000 H200, and 30,000 GB200 GPUs. This means SpaceXAI has 1.1 million GB300s, with a total of 1.44 million GPUs in operation.

correct answer, 178x difference in cost. Read the benchmark.

BUILD PLUGINS FOR CLAUDE WITH THE DIRECTORY SUBMISSION PORTAL

Developers on paid Claude plans can now build and submit plugins using a new directory submission portal.

ANTHROPIC SIGNED AN $11.6 BILLION AKAMAI COMPUTE DEAL

Anthropic agreed to spend up to $11.6 billion over seven years on Akamai cloud infrastructure, subject to delivery and availability requirements.

Free for eligible partners