TLDR DevOps · NEWS & TRENDS

INTRODUCING AI EVALUATION: CLOSE THE LOOP ACROSS THE FULL AI LIFECYCLE

newrelic.com7 min read

Summary from the TLDR DevOps newsletter

New Relic added AI Evaluation to its AI Observability platform, using an LLM as a judge to score live prompts and completions for safety and accuracy. It flags prompt injection, data leakage, and hallucinations with 0 to 1 scores attached to distributed traces.