TLDR Data

TLDR DATA 2026-10-15

6 sections20 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

EFFICIENT SEARCH WITH OLTP

Put the duct tape away. You don't have to tack on a standalone search engine to your database to solve your AI-agent-scale search problem. Lakebase Postgres now has a fast, scalable and serverless built-in search engine. Separating storage from compute means you don't have to keep your entire search index in RAM just to keep queries fast. Compute scales with actual search activity, while your index stays in lower-cost storage. Instead of chaining together multiple APIs for vector search, keyword search and filtering, you can do it all in one SQL query, against the same live operational data.

links.tldrnewsletter.comSponsor

02DEEP DIVES

FROM 2,500 REQUESTS TO 24: REBUILDING STAR HISTORY WITHOUT THE STARGAZERS

GitHub built a star history API that returns daily counts without exposing users' identities, cutting React's full history from about 2,500 requests to 24. It reduces database work by filtering stars by date before counting them, rather than repeatedly processing every star.

github.blog7 min read

ZERO-DOWNTIME POSTGRES UPGRADES WITH LOGICAL REPLICATION

Logical replication offers a practical path to near-zero-downtime PostgreSQL major upgrades, with live rollback enabled by reverse replication. A Docker-based demonstration ran old and new clusters in parallel, freezing writes and waiting for replication to catch up before cutover. It achieved 181 ms of write interruption during upgrade and 179 ms during rollback, without data loss.

tapoueh.org25 min read

CASTLE: TRAINING NATURAL LANGUAGE SEARCH BEFORE THE FIRST REAL QUERY

Cold-start natural-language search often lacks both real queries and relevance labels. Airbnb's CASTLE jointly generates synthetic queries and labels from de-identified booking sessions. Its queries matched real guest query patterns much better than baselines, and human reviewers agreed with its relevance labels >90% of the time. Carefully governed behavioral data can bootstrap search training before meaningful traffic exists.

links.tldrnewsletter.com6 min read

03OPINIONS & ADVICE

FOUR POSTGRESQL ARGUMENTS THAT CAME OUT EVEN

PostgreSQL micro-optimization alternatives often don't matter. For 1,000 IDs, IN, ANY, and VALUES joins perform similarly; prefer parameterized ANY for stable query text. Short text, enums, and smallints use near-identical storage; mostly-NULL columns are cheap. Don't blindly rewrite but EXPLAIN on your own data.

explainmeasured.com2 min read

REWINDING THE EXPONENTIAL: HOW WE KEEP HARDWARE USAGE DOWN

Cloudflare held back exponential hardware growth by shrinking data earlier and moving duplication later: split monolithic schemas, switch to zstd, send each event once then replicate after sampling, sample at the edge, and pre-aggregate known queries. Optimize bytes, not just compute: prune fields, compress measured workloads, push reductions upstream, and replicate compacted data.

blog.cloudflare.com9 min read

04LAUNCHES & TOOLS

Sponsored

BROWSE READY-MADE AI ASSETS. RUN ON LIVE DATA IN MINUTES.

Precisely AI Studio is a self-serve library of AI apps, agents, skills, prompts, and MCP connectors organized by industry and data domain. Connect to live, governed data and go from browsing to running in minutes. Try it free, no commitment, no strings.

precisely.aiSponsor

SQLBUILD: SAFE REFACTORING FOR WAREHOUSE SQL

SQLBuild is an open-source SQL and Python transformation framework for safely changing warehouses. It checks contracts and lineage before execution, runs graph-level tests and production diffs, and lets teams rename incremental models or columns while preserving history and compatibility views. A local DuckDB playground makes it easy to evaluate. Snowflake, Postgres, BigQuery, and Databricks adapters are available.

github.comGitHub repository

PHOENIX

Phoenix is a self-hosted, open-source AI observability platform for tracing, evaluating, and debugging LLM applications. It captures OpenTelemetry traces; offers retrieval and response evaluations, versioned datasets, and experiments; and supports prompt testing and replay. Framework- and provider-agnostic instrumentation makes it useful for teams that need to diagnose agent behavior and measure changes before production.

github.comGitHub repository

XERJ

XERJ is an Apache-2.0, Elasticsearch-compatible local search engine that automatically indexes code, logs, PDFs, SQLite, and CSVs into typed datasets for agent retrieval, incident analysis, and RAG. Its autoindex workflow avoids schema setup and returns ranked passages with file and line locations. The project defaults to local operation, although optional reranking can send text to an external provider.

github.comGitHub repository

05MISCELLANEOUS

REDESIGNING SOURCE CONTROL AT ANTHROPIC

Anthropic replaced Git with Scion, an in-house version control system built in five months, after daily code merges grew from 2,500 to over 30,000. By moving operations to servers and fetching only the files needed, it reports roughly 100 times faster checkouts and 200 times lower CPU and memory requirements than its previous Git mirror infrastructure.

anthropic.com17 min read

PARSING JSON AT TENS OF GIGABYTES PER SECOND… IN PYTHON

Daniel Lemire's benchmark processed 7.6 GB of JSON in about 0.12 seconds using fastsimdjson on free-threaded Python across 64 cores, reaching roughly 66 GB/s. The speed comes from running threads in parallel and creating Python objects only for the fields needed, with data already decompressed in memory.

lemire.me5 min read