CAN DATA AGENTS DO REAL ANALYSIS? (51 MINUTE PODCAST)

Summary from the TLDR Data newsletter

Data agents still struggle on realistic analytics tasks, especially when work depends on joins across systems, undocumented business context, and messy text transformations. Benchmark results suggest prompt engineering alone will not close that gap. The best agent passed 61% of benchmark queries on its first attempt, with a semantic layer significantly improving accuracy. The episode also explores query planning and custom inference engines to reduce AI SQL costs.