TLDR · PROGRAMMING, DESIGN & DATA SCIENCE

A/B TESTING CAN'T KEEP UP WITH AI

braintrust.dev4 min read

Summary from the TLDR newsletter

Evals are still a new practice for many product teams. A/B testing is no longer sufficient for AI product optimization because it's expensive to create variants. AI eliminates this constraint - it is now possible to have unlimited variants that automatically update periodically based on real-user feedback. The companies that evolve to think in evals will build products that improve faster than their competitors can run in a single A/B test.