TLDR DevOps · NEWS & TRENDS
INTRODUCING AI EVALUATION: CLOSE THE LOOP ACROSS THE FULL AI LIFECYCLE
Summary from the TLDR DevOps newsletter
New Relic added AI Evaluation to its AI Observability platform, using an LLM as a judge to score live prompts and completions for safety and accuracy. It flags prompt injection, data leakage, and hallucinations with 0 to 1 scores attached to distributed traces.