GEMINI ROBOTICS 1.5 BRINGS AI AGENTS INTO THE PHYSICAL WORLD

Summary from the TLDR AI newsletter

Google DeepMind has released two models that unlock agentic experiences with advanced thinking. Gemini Robotics 1.5 is a vision-language-action model that turns visual information and instructions into motor commands for a robot to perform a task. The model thinks before taking actions and shows its process and also learns across embodiments. Gemini Robotics-ER 1.5 is a vision-language model that reasons about the physical world, natively calls digital tools, and creates detailed multi-step plans to complete a mission. These advances will help developers build more capable and versatile robots that can actively understand their environments and complete complex multi-step tasks in a general way.