TLDR InfoSec · STRATEGIES & TACTICS

WINNING THE AI CYBER RACE: VERIFIABILITY IS ALL YOU NEED

sergejepp.substack.com13 min read

Summary from the TLDR InfoSec newsletter

AI-powered cyber offense is outpacing defense because offensive tasks offer binary, easily verifiable outcomes, while defensive tasks like SIEM analysis, GRC assessments, and forensics lack reliable mechanical verifiers, resulting in noise-heavy signals with precision rates below 1% that make model training ineffective. Research demonstrates the verifiability gap's impact: OpenAI's o3 achieved 90% CTF challenge success versus GPT-4's 20%, DARPA AIxCC results showed autonomous vulnerability detection improving from 37% to 77%, and Microsoft's Project Ire reached 98% precision by wrapping LLMs with proper tool scaffolding, compared to Google's Sec-Gemini at 12% precision without verifiers. Security leaders should prioritize building mechanical verifiers and adopt offense-first thinking through continuous AI red teaming, as whoever owns the verifiers wins the AI security race.