TLDR · BIG TECH & STARTUPS
MICROSOFT INTRODUCES NEWEST IN-HOUSE AI CHIP
Summary from the TLDR newsletter
The Microsoft Azure Maia 200 is a new in-house AI server chip designed for inferencing AI models with ludicrous speeds. It is the most efficient inference system Microsoft has ever deployed. The chip gives 30% more performance per dollar and 50% higher TDP than the first-gen Maia 100. It can hit up to 10 petaflops of FP4 compute, three times higher than Amazon's Trainium3.