Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

被引:0
作者
Honerkamp, Daniel [1 ]
Mahesheka, Harsh [1 ]
Von Hartz, Jan Ole [1 ]
Welschehold, Tim [1 ]
Valada, Abhinav [1 ]
机构
[1] University of Freiburg, Department of Computer Science, Freiburg im Breisgau
关键词
imitation learning; mobile manipulation; Teleoperation;
D O I
10.1109/LRA.2025.3540582
中图分类号
学科分类号
摘要
Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations. © 2025 IEEE.
引用
收藏
页码:3198 / 3205
页数:7
相关论文
共 46 条
  • [31] Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking With a Wheeled-Quadrupedal-Manipulator
    Jiang, Kaiwen
    Fu, Zhen
    Guo, Junde
    Zhang, Wei
    Chen, Hua
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (02): : 1481 - 1488
  • [32] Evaluation of grounded isometric interface for whole-body navigation in virtual environments
    Jang, Bong-gyu
    Kim, Gerard Jounghyun
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2014, 25 (5-6) : 561 - 575
  • [33] Bipedal Robot Walking Control Using Human Whole-Body Dynamic Telelocomotion
    Colin, Guillermo
    Sim, Youngwoo
    Ramos, Joao
    2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2023), 2023, : 12191 - 12197
  • [34] Knowledge-enabled parameterization of whole-body control strategies for compliant service robots
    Daniel Leidner
    Alexander Dietrich
    Michael Beetz
    Alin Albu-Schäffer
    Autonomous Robots, 2016, 40 : 519 - 536
  • [35] A Whole-Body Integrated AVATAR System: Implementation of Telepresence With Intuitive Control and Immersive Feedback
    Park, Sungman
    Kim, Junsoo
    Lee, Hojae
    Jo, Minwoong
    Gong, Dohoon
    Ju, Dawon
    Won, Dami
    Kim, Sihyeon
    Oh, Jinhyeok
    Jang, Hun
    Bae, Joonbum
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2023, : 2 - 10
  • [36] Knowledge-enabled parameterization of whole-body control strategies for compliant service robots
    Leidner, Daniel
    Dietrich, Alexander
    Beetz, Michael
    Albu-Schaeffer, Alin
    AUTONOMOUS ROBOTS, 2016, 40 (03) : 519 - 536
  • [37] Multicontact Motion Retargeting Using Whole-Body Optimization of Full Kinematics and Sequential Force Equilibrium
    Rouxel, Quentin
    Yuan, Kai
    Wen, Ruoshi
    Li, Zhibin
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2022, 27 (05) : 4188 - 4198
  • [38] Passivity of Time-Delayed Whole-Body Operational Space Control with Series Elastic Actuation
    Zhao, Ye
    Sentis, Luis
    2016 IEEE-RAS 16TH INTERNATIONAL CONFERENCE ON HUMANOID ROBOTS (HUMANOIDS), 2016, : 1290 - 1297
  • [39] Exploring Low-Cost Mobile Manipulation for Elder Care Within a Community Based Setting
    Mucchiani, Caio
    Cacchione, Pamela
    Torres, Wilson
    Johnson, Michelle J.
    Yim, Mark
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2020, 98 (01) : 59 - 70
  • [40] Exploring Low-Cost Mobile Manipulation for Elder Care Within a Community Based Setting
    Caio Mucchiani
    Pamela Cacchione
    Wilson Torres
    Michelle J. Johnson
    Mark Yim
    Journal of Intelligent & Robotic Systems, 2020, 98 : 59 - 70