STRING-MATCHING EVALS CAN REWARD AI AGENTS FOR FAKE COMPLIANCE

Summary from the TLDR AI newsletter

Checking whether generated code contains “Azure” only proves that the word appears somewhere, not that an agent actually used Azure or built working software.