Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

被引:0
|
作者
Honerkamp, Daniel [1 ]
Mahesheka, Harsh [1 ]
Von Hartz, Jan Ole [1 ]
Welschehold, Tim [1 ]
Valada, Abhinav [1 ]
机构
[1] University of Freiburg, Department of Computer Science, Freiburg im Breisgau,79085, Germany
关键词
Demonstrations - Manipulators - Reinforcement learning;
D O I
10.1109/LRA.2025.3540582
中图分类号
学科分类号
摘要
Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations. © 2025 IEEE.
引用
收藏
页码:3198 / 3205
相关论文
共 50 条
  • [21] Whole-Body Motion Planning for Manipulation of Articulated Objects
    Burget, Felix
    Hornung, Armin
    Bennewitz, Maren
    2013 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2013, : 1656 - 1662
  • [22] Planning Whole-body Humanoid Locomotion, Reaching, and Manipulation
    Yoshida, Eiichi
    Esteves, Claudia
    Kanoun, Oussama
    Poirier, Mathieu
    Mallet, Anthony
    Laumond, Jean-Paul
    Yokoi, Kazuhito
    MOTION PLANNING FOR HUMANOID ROBOTS, 2010, : 99 - +
  • [23] Whole-Body Diffusion-Weighted Imaging: The Added Value to Whole-Body MRI at Initial Diagnosis of Lymphoma
    Gu, Jing
    Chan, Tao
    Zhang, Jingbo
    Leung, Anskar Y. H.
    Kwong, Yok-Lam
    Khong, Pek-Lan
    AMERICAN JOURNAL OF ROENTGENOLOGY, 2011, 197 (03) : W384 - W391
  • [24] Whole-body Spatial Teleoperation Control of a Hexapod Robot in Unstructured Environment
    Fu, Junling
    Zhang, Junhao
    She, Ziyu
    Ovur, Salih Ertug
    Li, Wenjie
    Qi, Wen
    Su, Hang
    Ferrigno, Giancarlo
    De Momi, Elena
    2021 6TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2021), 2021, : 93 - 98
  • [25] Humanoid Dynamic Synchronization Through Whole-Body Bilateral Feedback Teleoperation
    Ramos, Joao
    Kim, Sangbae
    IEEE TRANSACTIONS ON ROBOTICS, 2018, 34 (04) : 953 - 965
  • [26] Dynamic Whole-Body Mobile Manipulation with a Torque Controlled Humanoid Robot via Impedance Control Laws
    Dietrich, Alexander
    Wimboeck, Thomas
    Albu-Schaeffer, Alin
    2011 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2011, : 3199 - 3206
  • [27] Reactive Whole-Body Control Dynamic Mobile Manipulation Using a Large Number of Actuated Degrees of Freedom
    Dietrich, Alexander
    Wimboeck, Thomas
    Albu-Schaeffer, Alin
    Hirzinger, Gerd
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2012, 19 (02) : 20 - 33
  • [28] Whole-body motion planning for pivoting based manipulation by humanoids
    Yoshida, Eiichi
    Poirier, Mathieu
    Laumond, Jean-Paul
    Kanoun, Oussama
    Lamiraux, Florent
    Alami, Rachid
    Yokoi, Kazuhito
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 3181 - +
  • [29] Object manipulation by hand using whole-body motion coordination
    Nishiwaki, Koichi
    Kagami, Satoshi
    Inoue, Hirochika
    Fukumoto, Yasutaka
    Inaba, Masayuki
    2005 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATIONS, VOLS 1-4, CONFERENCE PROCEEDINGS, 2005, : 1778 - 1783
  • [30] A Unified MPC Framework for Whole-Body Dynamic Locomotion and Manipulation
    Sleiman, Jean-Pierre
    Farshidian, Farbod
    Minniti, Maria Vittoria
    Hutter, Marco
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 4688 - 4695