TLDR Web Dev · MISCELLANEOUS
DO LLMS IDENTIFY FONTS?
Summary from the TLDR Web Dev newsletter
A live benchmark was created to test whether LLMs can identify fonts from dafont.com forum posts where users request font identification. The benchmark avoids contamination by only testing LLMs on new, unsolved forum posts and comparing their predictions to the eventual community solutions. GPT-4o-mini and Gemini-2.5-flash-preview-05-20 were both provided with images, titles, and descriptions, allowing up to five guesses each, but the results were surprisingly poor.