INFERENCEMAX

Summary from the TLDR AI newsletter

InferenceMAX continually re-benchmarks the world's most popular open-source inference frameworks and models to track real performance in real time. It captures progress in near real-time. A live dashboard is available for free.