OPENAI'S JALAPEÑO AI CHIP IS OPTIMIZED FOR INFERENCE EFFICIENCY

Summary from the TLDR IT newsletter

OpenAI has revealed more details about Jalapeño, its first custom AI accelerator built with Broadcom. The chip is rated at 700W but stayed at or below 550W in tested workloads, as OpenAI pushes to reduce inference costs and power use.