TLDR DevOps · OPINIONS & TUTORIALS

TEACHING A 9B MODEL TO INVESTIGATE PRODUCTION ALERTS

datadoghq.com9 min read

Summary from the TLDR DevOps newsletter

Datadog fine-tuned Qwen3.5-9B on traces from a larger teacher model to automate change attribution during incident investigations. The specialized student model achieved 87% of the teacher's recall while reducing inference costs by roughly 20 times to $0.003 per investigation. A single 40 GB A100 GPU can support approximately 100,000 of these investigations per week.