LMARENA HAS SOME COMPETITION: SCALE AI LAUNCHES SEAL SHOWDOWN, A NEW BENCHMARKING TOOL

Summary from the TLDR AI newsletter

Seal Showdown is a new benchmarking tool that allows users to test various AI models head-to-head and vote on which one performs better. Unlike LMArena, it captures real preferences to more closely reflect how everyday users feel about various models. Rankings are derived from conversations on Scale's Outlier platform, so each user's country, education level, profession, language, and age can be verified. This allows the platform to show which models are most popular according to specific regions, languages, ages, and use cases.