Daily Edition · Page 2

THE DAILY INDEX

Technology, AI, software, security, crypto and business

GENERAL

TLDR Founders

99% OF MY WEBSITE TRAFFIC IS BOTS

PatronView is a donor-research database with 1.5 million profile pages built from public records. In one week, its server served 1.28 million pages while analytics counted only 5,977 pageviews. That is 214 invisible loads for every visible one. Claude-SearchBot crawled 35,000 pages for every visitor it sent back. Amazon crawled 117,000 pages a day and sent none. Cloudflare's bot detector added 2.875 seconds and cut mobile Lighthouse to 58. Removing it restored 99, then an Azure scraper pulled 23,000 pages in an hour. The founder now judges crawlers by pages taken per visitor returned.

HOW TO KEEP THINKING

One engineer now runs six or seven AI-agent sessions on the same coding task. Some explore, others build competing versions, and more review and test. Things got faster, but his job slowly became skimming and judging answers instead of forming his own. So he added one deliberately slow habit. He reads dense nonfiction and writes about it without an LLM. As more research, code, and analysis move into agent queues, keep one place where you still have to start with a blank page and decide what you think.

TLDR IndexPage 2