THE NEW CHIPS DESIGNED TO SOLVE AI'S ENERGY PROBLEM

Summary from the TLDR newsletter

The estimated growth in energy required for AI is currently unsustainable. Several startups and companies are experimenting with new kinds of chips that have the potential to be much more energy efficient than current industry leaders at the all-important task of inference. While Nvidia chips will continue to be used for AI training for the foreseeable future, more efficient inference could collectively save companies tens of billions of dollars. The intensity of these chip development efforts shows how desperate the tech world is to provide AI to customers without paying the 'Nvidia tax'.