A GPU-HOUR ISN'T A COMMODITY IF YOU NEED FOUR OF THEM

Summary from the TLDR AI newsletter

Compute pricing coverage runs on headline rates, but many workloads don't consume them that way. Training, fine-tuning, and high-throughput inference need multiple identical GPUs in the same machine or cluster. A company that buys H100 futures to hedge a future four- or eight-GPU requirement carries real basis risk. The futures will hedge a rise in the broad H100 price and do nothing about the lack of co-located capacity.