INTRODUCING PAY PER CRAWL: ENABLING CONTENT OWNERS TO CHARGE AI CRAWLERS FOR ACCESS
Cloudflare's Pay Per Crawl lets content owners charge AI crawlers for access using HTTP 402 response codes. Publishers can set prices, allow or block crawlers, and manage payments through Cloudflare. Crawlers authenticate with signed headers and can agree to pricing via request. The system enables monetization at scale, laying the groundwork for future agent-driven transactions and dynamic licensing. Now in private beta, it gives creators more control over how their content is accessed online.