Daily Edition · Page 3

THE DAILY INDEX

Technology, AI, software, security, crypto and business

HEADLINES & LAUNCHES

TLDR AI

THE EMERGING ROLE OF SRAM-CENTRIC CHIPS IN AI INFERENCE

SRAM-centric chips, like those from Cerebras and Groq, are gaining traction due to their advantages in AI inference workloads, particularly in minimizing latency and increasing throughput compared to traditional GPUs. This shift is driven by the demand for near-compute memory architectures, which offer faster data access than far-compute approaches like DRAM. The trade-off lies in balancing memory bandwidth and compute capacity, leading to new disaggregated hardware strategies that optimize both prefill and decode phases of AI tasks across varied hardware platforms.

YOUR LLM DOESN'T WRITE CORRECT CODE. IT WRITES PLAUSIBLE CODE.

A benchmarked LLM-generated Rust rewrite of SQLite ran 20,171x slower on primary key lookups because the query planner never checked the is_ipk flag, sending every WHERE clause through a full table scan instead of a B-tree search. The same author's disk cleanup daemon came in at 82,000 lines with a Bayesian scoring engine and PID controller to solve a problem that a one-line cron job already handles. The root failure is structural: LLMs optimize for plausible output matching the user's intent, and METR's RCT with 16 experienced open-source developers confirmed the problem scales, finding AI users were 19% slower while believing they were 20% faster.

GOOGLE PM OPEN-SOURCES ALWAYS ON MEMORY AGENT, DITCHING VECTOR DATABASES FOR LLM-DRIVEN PERSISTENT MEMORY

The Always On Memory Agent is an agent system that ingests information continuously, consolidates it in the background, and then retrieves it later without relying on a conventional vector database. It is available on the official Google Cloud Platform GitHub page under a permissive MIT License that allows for commercial usage. Enterprise AI teams are moving beyond single-turn assistants into systems expected to remember preferences, preserve project context, and operate across longer horizons. The Always On Memory Agent offers a concrete starting point for that next layer of infrastructure.

TLDR IndexPage 3