99% OF MY WEBSITE TRAFFIC IS BOTS

Summary from the TLDR Founders newsletter

PatronView is a donor-research database with 1.5 million profile pages built from public records. In one week, its server served 1.28 million pages while analytics counted only 5,977 pageviews. That is 214 invisible loads for every visible one. Claude-SearchBot crawled 35,000 pages for every visitor it sent back. Amazon crawled 117,000 pages a day and sent none. Cloudflare's bot detector added 2.875 seconds and cut mobile Lighthouse to 58. Removing it restored 99, then an Azure scraper pulled 23,000 pages in an hour. The founder now judges crawlers by pages taken per visitor returned.