TLDR Data

TLDR DATA 2026-08-03

5 sections14 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01DEEP DIVES

HOW DOORDASH BUILT A CENTRALIZED GATEWAY FOR AI AGENT-TOOL ACCESS

DoorDash built a centralized Agent Gateway that gives AI agents governed access to MCP tools, handling identity, authorization, credentials, filtering, observability, and rate limits. It now supports 200+ MCP servers and millions of weekly calls while improving security, reliability, and control.

careersatdoordash.com13 min read

PARTING THE CLOUDS: THE RISE OF DISAGGREGATED SYSTEMS (47 MINUTE VIDEO)

Cloud databases are increasingly separating stateless compute from shared storage to improve elasticity, failover, and pay-per-use economics. The tradeoff is remote I/O latency and bandwidth, so systems such as Aurora, AlloyDB, DSQL, PolarDB, and TaurusDB lean on buffering, prefetching, pushdown, RDMA/CXL, and careful log/storage design.

infoq.com

02OPINIONS & ADVICE

OPENAI JUST MADE ANALYTICS 10X CHEAPER

OpenAI's cheaper GPT 5.6 Luna shifts agentic analytics toward small, fast models paired with low-latency analytical databases, delivering highly accurate SQL answers for under half a cent while making frequent evals far more affordable. The advantage now comes less from using the smartest model and more from strong business context, rigorous model-agnostic evals, and a responsive data platform.

motherduck.com6 min read

BEYOND HAPPY PATH ENGINEERING: DATABASES

Production databases fail at the edges: stale replica reads, ambiguous commits, deadlocks, and live migrations can break flows that pass the happy-path tests. The practical takeaway is to enforce invariants at the database boundary with guarded writes, constraints, short transactions, idempotent retries, and explicit recovery procedures.

blog.gaborkoos.com18 min read

KAFKA'S BROKEN PROMISE: THERE IS NO GOLDILOCKS LOG

Kafka's partitioned stream model is a poor fit for router-style workloads with millions of independently keyed ordered logs. OpenData Log is built in Rust on object storage and SlateDB. It uses segmented LSM storage, key-based scans, metadata-only splits, and read replicas to support high-cardinality log routing more cheaply.

opendata.dev7 min read

03LAUNCHES & TOOLS

ASYNCHRONOUS I/O IN DUCKDB: WORK, THREAD, WORK

DuckDB is adding asynchronous I/O so worker threads stop blocking on S3-backed Parquet and CSV reads. The design separates async and worker pools, adds read-ahead and memory governance, and shows some large performance wins: TPC-H Q6 on 22 GB Parquet fell from 8.23s to 2.84s, while a large CSV scan time improved by nearly 20x.

duckdb.org12 min read

VIDEO NEEDS A KNOWLEDGE BASE

Video is difficult to use because it can be stored and watched but not queried, forcing manual review or repeated AI processing. CreativAI's platform structures footage once into a searchable knowledge base for fast queries across robotics, logistics, safety, compliance, and physical AI use cases.

creativ-ai.com6 min read

XBERG

Xberg is an open-source engine that extracts text, tables, metadata, and structured data from 101 formats, including PDFs, images, audio, video, URLs, archives, and code. Its Rust core supports 15 languages plus OCR, transcription, embeddings, structured extraction, and deployment through libraries, CLI, REST, MCP, Docker, or Helm.

github.comGitHub repository

04MISCELLANEOUS

PGSIMCITY

PGSimCity is an interactive educational simulator that represents a PostgreSQL database as a 3D city. You can adjust workload settings or trigger scenarios such as checkpoint storms, cache thrashing, autovacuum blockages, lock pile-ups, and replication lag to see how PostgreSQL's internal systems affect performance.

nikolays.github.ioTool

DATA LESSONS FROM INSIDE META (SHRIDHAR IYER)

Meta's data platform evolved into a strongly typed, unified stack with centralized catalog, taxonomy, lineage, and policy layers. Its scale lessons: one truncated debug column saved millions of dollars, core tables serving 40–50% of the warehouse required versioning rather than deletion, and AI-readiness starts with reusable workflow primitives.

roundup.getdbt.com12 min read