TLDR Web Dev · MISCELLANEOUS
$2 H100S: HOW THE GPU BUBBLE BURST
Summary from the TLDR Web Dev newsletter
The price of H100 GPUs has plummeted from $8/hour to under $2/hour in just a year. This is due to the resales of reserved compute, the rise of open-source models for fine-tuning, and a decline in the number of companies developing new foundation models.