TLDR AI · DEEP DIVES & ANALYSIS

KIMI K3 ON AMD

wafer.ai8 min read

Summary from the TLDR AI newsletter

Wafer reported 952 tokens per second per node when serving Kimi K3 on AMD MI355X GPUs, with better performance per dollar than its Blackwell deployments. The results suggested that high-memory accelerators and improving software support could narrow AMD's inference gap with Nvidia.