LIES, DAMNED LIES, AND BENCHMARKS

Summary from the TLDR newsletter

Benchmarks are useful tools, but they're not the best indicators of real-world utility due to their narrow scopes, overfitting, contamination, reproducibility issues, and lack of scope.