TLDR Data

TLDR DATA 2026-09-24

6 sections17 entrieslinks blockcomplete parse

Parse notes

  • Subscription/account footer truncated before parsefooter_truncated

01GENERAL

Sponsored

RUN CLICKHOUSE WORKFLOWS FROM APACHE AIRFLOW

The official ClickHouse provider lets you create tables, load data and run SQL from your Airflow DAGs. It works with self-managed Airflow and Astronomer. Set up the provider [5], connect it to ClickHouse Cloud and try it with your own data.

clickhouse.comSponsor

02DEEP DIVES

WE PORTED THE ORIGINAL DOOM TO SQL

CedarDB ported the original Doom's game logic and renderer almost entirely to SQL, running the game loop at its original 35 Hz and rendering at up to 60 FPS. The experiment shows that surprisingly complex real-time logic can work with SQL's set-based model, while database features like transactions, access control, and shared state make multiplayer particularly natural.

cedardb.com25 min read

IF YOU LAST USED CASSANDRA 3.11, YOU MIGHT NOT RECOGNIZE IT TODAY

Apache Cassandra 5 loosens many of the constraints teams learned with 3.11, adding storage-attached indexing, unified compaction, native vector search, and built-in repair scheduling. Cassandra 6 goes further with ordered cluster metadata and cross-partition transactions, although partitioning and workload design remain fundamental.

softwaremill.com10 min read

HOW CONCURRENCE GOVERNS CLINICAL AI AT A TRILLION-TOKEN SCALE WITH UNITY GATEWAY

Concurrence uses Databricks to run and govern clinical AI at an annualized scale of roughly 1.2 trillion input tokens, combining patient data, agent state, testing, evaluations, and access controls on one platform. Unity Gateway centralizes access to approved AI models and tools, helping the company track usage, enforce compliance, and safely scale both clinical and coding agents.

databricks.com7 min read

03OPINIONS & ADVICE

BENCHMARKS ARE MORE BROKEN THAN WE COULD HAVE IMAGINED

Horizon audited over 5,000 AI benchmark tasks across 20 datasets and confirmed 29 were broken, with problems including leaked answers, incomplete tests, gameable graders, and failing reference solutions. Many of these flaws actually inflated model scores, highlighting how benchmark results can overstate capabilities when the underlying tasks and graders are unreliable.

horizonanalyticslabs.com15 min read

REAL-TIME LLM GUARDRAILS WITH JEV: COMPARING LATENCY AND COST

TypeSafe's Jev uses a purpose-built decision model for real-time AI guardrails, checking agent inputs, responses, and tool calls before they execute. In Arize's tests, it made the same decisions as GPT-5.4 nano while running 15-18x faster and costing 12-14x less per call.

arize.com13 min read

04LAUNCHES & TOOLS

Sponsored

EARN YOUR MASTER OF TRANSLATIONAL DATA ANALYTICS ONLINE FROM THE OHIO STATE UNIVERSITY.

Become an expert in data storytelling with the online Master of Translational Data Analytics from Ohio State's Translational Data Analytics Institute. This interdisciplinary program blends machine learning, user experience, data visualization, and design thinking to prepare you to uncover and present insights from data.

online.osu.eduSponsor

JEVFLAKE

Jevflake brings TypeSafe's Jev decision model into Snowflake through SQL functions and dbt, letting teams classify, score, and ask structured questions about their data with probabilistic answers. It can cache results in dbt models and add tests or human-review queues, making AI classifications reusable parts of normal analytics workflows.

github.comGitHub repository

INTRODUCING PROMPT_JEV(): BRINGING JEV TO MOTHERDUCK SQL

MotherDuck's new prompt_jev function brings Jev directly into SQL, letting users classify and score text at analytics scale without training a model or parsing LLM responses. In its 100,000-row benchmark, Jev achieved 89% accuracy in 40 seconds for $0.50, outperforming the tested LLMs on speed, cost, and accuracy.

motherduck.com5 min read

DUCKDB NOW SHIPS INSIDE DBT V2

dbt v2's Rust-based Fusion engine now includes a built-in DuckDB adapter, removing the need for a separate adapter installation. It adds DuckLake and Iceberg REST catalog support, writes queryable project metadata as Parquet, and performs SQL analysis that finds type or column problems before warehouse execution. The migration path starts by testing the opt-in v2 parser against existing projects.

duckdb.org6 min read

ANNOUNCING APACHE FLUSS 1.0: REAL-TIME DATA FOUNDATION FOR AI

Apache Fluss 1.0 introduces a stateless Rust HTTP Gateway for metadata, table operations, and batch writes, alongside native Python access and deeper Flink, Spark, Hudi, and Paimon integration. It adds row and log TTLs, predicate pushdown, coordinator high availability, resource protection, and cleanup features, moving the project from incubator-era capabilities toward production real-time lakehouse workloads.

fluss.apache.org15 min read

05MISCELLANEOUS

HIGH-THROUGHPUT OLTP IN THREE SIMPLE STEPS

High-throughput transaction systems benefit from co-design rather than copying a connection-pool pattern from a general-purpose database. TigerBeetle models linked transfers atomically, aggregates balances without scans, batches operations automatically while a request is in flight, and prefers time-ordered identifiers for fast idempotency checks. Its benchmark illustrates why batching and ordered IDs can matter more than adding clients.

tigerbeetle.com6 min read

HOW ADAPTIVE TAIL SAMPLING WORKS IN THE OPENTELEMETRY COLLECTOR

Fixed-rate sampling often discards the rare traces needed in an incident, while ordinary tail sampling loses statistical weights. An adaptive tail sampler for the OpenTelemetry Collector buffers traces, applies ordered rules, and attaches W3C probability thresholds so downstream counts can be reweighted. It adapts by route and service, bounds memory under load, and is progressing upstream toward alpha.

honeycomb.io7 min read