Daily Edition · Page 4

THE DAILY INDEX

Technology, AI, software, security, crypto and business

Continued

TLDR AI — continued

XAI LAUNCHES GROK STT AND TTS APIS

xAI has launched standalone Grok Speech to Text (STT) and Text to Speech (TTS) APIs, enhancing developer options for integrating advanced speech capabilities. These APIs support high accuracy, low latency, word-level timestamps, speaker diarization, and intelligent inverse text normalization across 25+ languages. Grok STT excels in transcription accuracy within phone calls and video/podcasts, providing robust solutions for medical, legal, and financial sectors.

PREFILL-AS-A-SERVICE: KVCACHE OF NEXT-GENERATION MODELS COULD GO CROSS-DATACENTER

Prefill-as-a-Service (PrfaaS) is a cross-datacenter serving architecture that selectively offloads long-context prefill to standalone, compute-dense prefill clusters and transfers the resulting KVCache over commodity Ethernet to local PD clusters for decode. It combines model-side KV efficiency with system-side selective offloading, bandwidth-aware scheduling, and cache-aware request placement. The design removes the requirement that heterogeneous accelerators share the same low-latency RDMA fabric and enables independent scaling of prefill and decode capacity across loosely coupled clusters. A PrfaaS-augmented heterogeneous deployment achieves higher serving throughput while consuming only modest cross-datacenter bandwidth.

DIVE INTO CLAUDE CODE: THE DESIGN SPACE OF TODAY'S AND FUTURE AI AGENT SYSTEMS

Claude Code is an agentic coding tool that can run shell commands, edit files, and call external services on behalf of the user. This study describes its architecture by analyzing the publicly available TypeScript source code and further comparing it with OpenClaw. The core of the system is a simple while-loop that calls the model, runs tools, and repeats. OpenClaw uses the same recurring design questions but produces different architectural answers when the deployment context changes. The study also identifies six open design directions for future agent systems.

GOOGLE IS IN TALKS WITH MARVELL TO BUILD CUSTOM AI INFERENCE CHIPS AS IT DIVERSIFIES BEYOND BROADCOM

Google is in talks with Marvell Technology to develop a memory processing unit and an inference-optimized TPU. The custom ASIC market is projected to grow 45% in 2026 and reach $118 billion by 2033. Broadcom, Google's primary custom chip partner, recently announced a long-term agreement to design and supply TPUs and networking components through to 2031. Talks with Marvell have yet to produce a signed contract.

TLDR IndexPage 4