TLDR · BIG TECH & STARTUPS
MICROSOFT PREPARES TO PUT GIGAWATTS OF ITS CHIPS IN DATA CENTERS
Summary from the TLDR newsletter
Microsoft's newest iteration of its Maia chips will start rolling out next year. The Maia 300 is designed to handle inference. Microsoft expects to stock multiple gigawatts of the chips at its server farms. The Maia 300 delivers 40% more tokens per megawatt than leading GPU-based systems. Microsoft isn't currently planning to rent the underlying computing power of Maia chips directly to its cloud customers.