TLDR Data

TLDR DATA 2026-10-26

6 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

CAN AN LLM EVER BE EXPLAINABLE?

The classic XAI methods explain a prediction in terms of input features, such as income, account age or pixels. With LLMs, these approaches are often insufficient. Read this article on the Seekr blog [5] to learn: * Why SHAP and LIME fall short on LLMs, and what evidence replaces them * The 4 sources of an LLM explanation [6] and what each can and can't prove * How to test whether a model actually relied on a cited source

seekr.comSponsor

02DEEP DIVES

RAPIDLY SCALING ONLINE STORAGE TO SERVE OVER 1 BILLION CHATGPT USERS

OpenAI's storage platform, Habitat, serves over 500 petabytes to over 1 billion users. Its Azure Cosmos DB setup went from one shared container to one per feature, then back to shared after teams forgot to pre-scale for launches. With hot key throttling, request priorities, and a new serverless mode, it has had no noisy-neighbour incidents since.

links.tldrnewsletter.com23 min read

REBUILDING LINKEDIN'S TRACKING INFRASTRUCTURE

LinkedIn's tracking pipeline handles hundreds of billions of events a day, feeding experiments and product analytics. The team moved it off Java 8 and the Play Framework onto gRPC and a modern Java runtime. Before shifting traffic, they sent 10% of events through both pipelines and compared the output. Inbound network usage fell about 89%.

linkedin.com13 min read

A FILE FORMAT CLAIMS TO BE 100X FASTER THAN PARQUET

Parquet's scan-oriented design is showing strain under AI workloads that need fast random access to embeddings and multimodal data. Lance tackles that mismatch with a layout built for direct page access and finer-grained reads, reducing metadata overhead and memory pressure. The broader takeaway is that AI-era storage may need to optimize for point retrieval, not just analytical scans.

vutr.substack.com7 min read

SINGLE-TENANT TITUS: VM-LEVEL ISOLATION ON A MULTI-TENANT CONTAINER PLATFORM

Netflix is adding a single-tenant mode to Titus so sensitive workloads can get a dedicated VM without leaving the existing container platform. The motivation is noisy-neighbor interference at the hardware level, which can trigger severe tail-latency spikes for stateful systems. Dedicated nodes improved stability and even recovered capacity lost to anti-affinity, though with slower launches and more warm-capacity planning.

netflixtechblog.com26 min read

03OPINIONS & ADVICE

CAN DATA AGENTS DO REAL ANALYSIS? (51 MINUTE PODCAST)

Data agents still struggle on realistic analytics tasks, especially when work depends on joins across systems, undocumented business context, and messy text transformations. Benchmark results suggest prompt engineering alone will not close that gap. The best agent passed 61% of benchmark queries on its first attempt, with a semantic layer significantly improving accuracy. The episode also explores query planning and custom inference engines to reduce AI SQL costs.

roundup.getdbt.com

WE BUILT THREE MEMORY SYSTEMS. THE MOST EXPRESSIVE ONE WASN'T THE MOST USEFUL

Tiger Data gave its Slack agent memory three ways: a list of facts, a knowledge graph, and a tree. Agents struggled to decide what graph edges meant. A tree built on Postgres's ltree extension worked better, and filing a thread summary dropped from dozens of turns to one tool call. Its search layer became searchgres.js.

tigerdata.com9 min read

04LAUNCHES & TOOLS

Sponsored

AGENTS SHOULD QUERY YOUR METRICS, NOT YOUR TABLES

One metric, twenty different queries, nobody sure which is right. An agent produces the disagreement faster. CUBE [15] is the semantic layer for AI: define a metric once, and dashboards, apps and agents use that definition — LLM accuracy up 17–23 points. GET THE GUIDE OR TRY FREE → [16] No card required

cube.devSponsor

DUCKDB HF EXTENSION — READ AND WRITE HUGGING FACE ASSETS

The DuckDB hf extension lets you read, query, and write files on Hugging Face directly with SQL using hf:// URLs. It supports datasets, models, and storage buckets, with caching to speed up reads and deduplication to avoid uploading data already stored.

github.comGitHub repository

BBTREE: FASTEST ORDERED MAP

bbtree is a Rust ordered map whose benchmarks report up to 5x faster single-threaded performance than Rust's BTreeMap and 30% lower memory use. It applies decades of database research to reduce memory delays, with LLM-written code guided by a database expert and checked through formal verification and extensive testing.

bbtree.xiangpeng.systems6 min read

SUTURA

Sutura is an Apache-2.0 Rust runtime that exposes certified metrics and semantic definitions to AI agents over HTTP or MCP, rather than letting them improvise directly against warehouse tables. It can federate queries across systems while verifying the caller and preserving data-source policies. The useful idea is a governed agent-access boundary where metrics, identities, and query execution travel together.

github.comGitHub repository

05MISCELLANEOUS

GO WITH THE FLOW: TAKING A SHADOW DEPENDENCY IN GCP DATAFLOW CROSS TENANT

Researchers uncovered a cross-tenant GCP Dataflow flaw where predictable default staging bucket names could let an attacker hijack staged artifacts and reach remote code execution on workers. Google has fixed the issue. Key takeaway: cloud pipelines should verify artifact ownership and integrity instead of trusting default infrastructure names or first-run setup paths.

varonis.com5 min read

HUNTING REPLICATION LAG: A QUEUE-BY-QUEUE METHOD FOR DIAGNOSING ORACLE GOLDENGATE

GoldenGate replication lag is best treated as a queueing problem across the whole pipeline, not something to blame on Replicat by default. The best approach is measuring each hop with heartbeat timestamps to find where backlog actually grows. That matters for both freshness and correctness, since in active-active systems lag also widens the conflict window.

hackernoon.com10 min read