TLDR AI · DEEP DIVES & ANALYSIS
KIMI K3 ON AMD
Summary from the TLDR AI newsletter
Wafer reported 952 tokens per second per node when serving Kimi K3 on AMD MI355X GPUs, with better performance per dollar than its Blackwell deployments. The results suggested that high-memory accelerators and improving software support could narrow AMD's inference gap with Nvidia.