TLDR InfoSec · STRATEGIES & TACTICS

REVOLUTIONIZING SOFTWARE TESTING: INTRODUCING LLM-POWERED BUG CATCHERS

engineering.fb.com6 min read

Summary from the TLDR InfoSec newsletter

Mutation testing is the process by which automatic test cases are programmatically created based on existing test cases to increase code coverage. Meta created the Automated Compliance Hardening (ACH) system to use LLMs to generate mutants to model realistic inputs. A developer uses ACH by describing the types of bugs that they're concerned about, ACH then generates a series of bugs and converts them into tests to run.