HOW WE DISCOVERED OVER 18,000 API SECRET TOKENS

Summary from the TLDR InfoSec newsletter

The Escape team underwent a project to spider 189.5M URLs to search for API keys and discovered 18,000 secrets, which included $20M in vulnerable Stripe tokens. This post covers how the team built a custom web spider using Golang and fasthttp along with the data analysis and verification pipeline. The process was deployed on a k8s cluster that could scale to 150 concurrent worker instances. The data collection took over 69 hours.