WILDLMA: LONG HORIZON LOCO-MANIPULATION IN THE WILD

Summary from the TLDR AI newsletter

WildLMa is a framework that enables quadruped robots to perform complex manipulation tasks in real-world environments. The system combines three key components: a whole-body controller for VR-enabled teleoperation, a library of generalizable skills learned through imitation learning (WildLMa-Skill), and a language model-based planner (WildLMa-Planner) that coordinates these skills for long-term tasks. In this paper, researchers demonstrate how it can be used for tasks like cleaning up trash in hallways and rearranging items on bookshelves. The framework maintains effectiveness across diverse environments and object configurations.