INTRODUCING NVIDIA COSMOS POLICY FOR ADVANCED ROBOT CONTROL

Summary from the TLDR AI newsletter

Cosmos Policy is a robot control and planning policy that post-trains the Cosmos Predict-2 world foundation model for manipulation tasks. It adapts the pretrained model directly through a single stage of post-training on robot demonstration data. Cosmos Policy treats robot actions, physical states, and success scores just like frames in a video. As a result, a single model can predict action chunks to guide robot movement using hand-eye coordination, predict future robot observations for world modeling, and predict expected returns for planning.