THE INFERENCE ECONOMY: TOKEN USE

Summary from the TLDR Founders newsletter

Token demand is going up. Everyone should be thinking about how to manage token usage as models will get more expensive as they get better. Businesses need to consider whether they are using the right-sized model for their project and whether reasoning is really required. They need to be flexible with providers and only use fine-tuning/post-training if they have enough data, expertise, and resources.