TLDR Web Dev · MISCELLANEOUS

$2 H100S: HOW THE GPU BUBBLE BURST

latent.space23 min read

Summary from the TLDR Web Dev newsletter

The price of H100 GPUs has plummeted from $8/hour to under $2/hour in just a year. This is due to the resales of reserved compute, the rise of open-source models for fine-tuning, and a decline in the number of companies developing new foundation models.