TLDR · MISCELLANEOUS

CUTTING-EDGE AI WAS SUPPOSED TO GET CHEAPER. IT'S MORE EXPENSIVE THAN EVER

links.tldrnewsletter.com7 min read

Summary from the TLDR newsletter

The latest AI models are doing more 'thinking', driving up the costs to complete tasks despite the cost of tokens dropping. This is the opposite of what many analysts and experts predicted even just a few months ago. Reasoning can deliver meaningfully better responses, but it spends significantly more tokens in the process. One way to lower costs is to use 'dumber' AIs - many use-cases don't require cutting-edge AI.