Daily Edition · Page 4

THE DAILY INDEX

Technology, AI, software, security, crypto and business

ARTICLES & TUTORIALS

TLDR Web Dev

TOKENS ARE GETTING MORE EXPENSIVE

AI subscriptions are headed for a "short squeeze" despite the expectation that language model costs will decrease. The problem lies in the demand for the newest, most powerful models, which remain expensive, and the exponential increase in token consumption as AI agents become more capable. Unlimited subscription models are unsustainable, as users can exploit them to consume enormous amounts of tokens (which is why Claude is introducing weekly limits now).

PERPLEXITY IS USING STEALTH, UNDECLARED CRAWLERS TO EVADE WEBSITE NO-CRAWL DIRECTIVES

Cloudflare has discovered that Perplexity, an AI-powered answer engine, is using stealth crawling techniques to bypass website restrictions. Perplexity appears to be masking its crawler identity by modifying its user agent, rotating IPs, and ignoring robots.txt files after being blocked. This behavior violates established internet norms of transparency and respect for website preferences, so Cloudflare has responded by delisting Perplexity as a verified bot and implementing rules to block this stealth crawling activity.

DO LLMS IDENTIFY FONTS?

A live benchmark was created to test whether LLMs can identify fonts from dafont.com forum posts where users request font identification. The benchmark avoids contamination by only testing LLMs on new, unsolved forum posts and comparing their predictions to the eventual community solutions. GPT-4o-mini and Gemini-2.5-flash-preview-05-20 were both provided with images, titles, and descriptions, allowing up to five guesses each, but the results were surprisingly poor.

TLDR IndexPage 4