MOLMOMOTION: LANGUAGE-GUIDED 3D MOTION FORECASTING

Summary from the TLDR AI newsletter

MolmoMotion, a new motion forecasting model, predicts future 3D point trajectories in videos using language instructions and initial object positions, outperforming existing methods. The model and its dataset, MolmoMotion-1M, feature vast datasets of 3D point trajectories from 1.16M videos, with a benchmark for accuracy testing.