TLDR AI · ENGINEERING & RESEARCH

TIMESCOPE: HOW LONG CAN YOUR VIDEO LARGE MULTIMODAL MODEL GO?

simonwillison.net2 min read

Summary from the TLDR AI newsletter

TimeScope is a new open source benchmark for evaluating vision models on how well they handle long videos. It evaluates not just retrieval but synthesis, localization, and fine-grained motion analysis to provide a more holistic view of temporal comprehension. Using the benchmark reveals how model size isn't everything - simply scaling parameters doesn't automatically grant a longer temporal horizon - and Gemini 2.5-Pro is in a league of its own, being the only model able to maintain strong accuracy on videos longer than an hour.