WILL IT MYTHOS?

Summary from the TLDR Dev newsletter

Mythos is a security tool believed to be amazing at finding vulnerabilities, but there's skepticism about the validity of its claims and operational costs that may limit broader access. Therefore, a benchmarking project was launched to test whether other AI models could match Mythos's performance in identifying security bugs, using a collection of confirmed vulnerabilities it had previously found. Preliminary results show that, while some models performed surprisingly well, none consistently outperformed Mythos.