TLDR AI · ENGINEERING & RESEARCH

GOOGLE UNVEILS DEFENSE STRATEGIES AGAINST AI PROMPT INJECTION ATTACKS

deepmind.google5 min read

Summary from the TLDR AI newsletter

Google DeepMind's research on defending Gemini against indirect prompt injection attacks reveals that more capable models aren't inherently more secure, and defenses that work in static tests often fail against adaptive attackers. Their findings show that "adversarial training" - fine-tuning models on examples of malicious prompts - significantly improved Gemini 2.5's resistance without degrading performance on normal tasks. When they combined this approach with a "Warning" defense, attack success rates plummeted from 94.6% to just 6.2%.