INTRODUCING GPT-REALTIME AND REALTIME API UPDATES FOR PRODUCTION VOICE AGENTS

Summary from the TLDR newsletter

OpenAI's Realtime API, powered by gpt-realtime, enables developers to build reliable, production-ready voice agents. It supports remote MCP servers, image inputs, and phone calling through Session Initiation Protocol. OpenAI has released two new voices in the Realtime API, Cedar and Marin. OpenAI's most advanced speech-to-speech model yet, gpt-realtime shows improvements in following complex instructions, calling tools with precision, and production of speech that sounds more natural and expressive.