AI IN PRODUCTION: PANELLISTS HIGHLIGHT SILENT FAILURES, HARNESS ENGINEERING, AND AGENT GOVERNANCE

Summary from the TLDR Data newsletter

Agentic systems can fail while conventional telemetry stays green: semantic drift can corrupt business meaning, and an embedding-model update can abruptly change policy decisions. Production controls therefore need continuous evals fed by live edge cases, separate agent identities with tiered permissions, and human approval of business risk. Treating agents as ordinary application code or relying on prompts for security leaves blind spots.