DEBUGGING OUR AI SEARCH ASSISTANT WITH AGENT TRACING

Summary from the TLDR Dev newsletter

Sentry uses agent traces to debug failures in a search assistant that converts natural language into Sentry query syntax. A trace exposed a prompt bug that listed custom numeric fields as bare names instead of the required tags[name, number] form, which caused valid searches to return no results. Instrumenting local evals with the same tracing now lets the team inspect prompts, tool calls, and backend requests before changes reach production.