Whole-Body Teleoperation for Mobile Manipulation at Zero Added Cost

被引:0
|
作者
Honerkamp, Daniel [1 ]
Mahesheka, Harsh [1 ]
Von Hartz, Jan Ole [1 ]
Welschehold, Tim [1 ]
Valada, Abhinav [1 ]
机构
[1] University of Freiburg, Department of Computer Science, Freiburg im Breisgau,79085, Germany
关键词
Demonstrations - Manipulators - Reinforcement learning;
D O I
10.1109/LRA.2025.3540582
中图分类号
学科分类号
摘要
Demonstration data plays a key role in learning complex behaviors and training robotic foundation models. While effective control interfaces exist for static manipulators, data collection remains cumbersome and time intensive for mobile manipulators due to their large number of degrees of freedom. While specialized hardware, avatars, or motion tracking can enable whole-body control, these approaches are either expensive, robot-specific, or suffer from the embodiment mismatch between robot and human demonstrator. In this work, we present MoMa-Teleop, a novel teleoperation method that infers end-effector motions from existing interfaces and delegates the base motions to a previously developed reinforcement learning agent, leaving the operator to focus fully on the task-relevant end-effector motions. This enables whole-body teleoperation of mobile manipulators with no additional hardware or setup costs via standard interfaces such as joysticks or hand guidance. Moreover, the operator is not bound to a tracked workspace and can move freely with the robot over spatially extended tasks. We demonstrate that our approach results in a significant reduction in task completion time across a variety of robots and tasks. As the generated data covers diverse whole-body motions without embodiment mismatch, it enables efficient imitation learning. By focusing on task-specific end-effector motions, our approach learns skills that transfer to unseen settings, such as new obstacles or changed object positions, from as little as five demonstrations. © 2025 IEEE.
引用
收藏
页码:3198 / 3205
相关论文
共 50 条
  • [1] Dynamic Mobile Manipulation via Whole-Body Bilateral Teleoperation of a Wheeled Humanoid
    Purushottam, Amartya
    Xu, Christopher
    Jung, Yeongtae
    Ramos, Joao
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2024, 9 (02) : 1214 - 1221
  • [2] Dynamic Planning for Sequential Whole-body Mobile Manipulation
    Li, Zhitian
    Niu, Yida
    Su, Yao
    Liu, Hangxin
    Jiao, Ziyuan
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [3] Control Model Learning for Whole-Body Mobile Manipulation
    Kuindersma, Scott
    PROCEEDINGS OF THE TWENTY-FOURTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE (AAAI-10), 2010, : 1939 - 1940
  • [4] Whole-Body Teleoperation and Shared Control of Redundant Robots with Applications to Aerial Manipulation
    Andre Coelho
    Yuri Sarkisov
    Xuwei Wu
    Hrishik Mishra
    Harsimran Singh
    Alexander Dietrich
    Antonio Franchi
    Konstantin Kondak
    Christian Ott
    Journal of Intelligent & Robotic Systems, 2021, 102
  • [5] Whole-Body Teleoperation and Shared Control of Redundant Robots with Applications to Aerial Manipulation
    Coelho, Andre
    Sarkisov, Yuri
    Wu, Xuwei
    Mishra, Hrishik
    Singh, Harsimran
    Dietrich, Alexander
    Franchi, Antonio
    Kondak, Konstantin
    Ott, Christian
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2021, 102 (01)
  • [6] Humanoid teleoperation for whole body manipulation
    Stilman, Mike
    Nishiwaki, Koichi
    Kagami, Satoshi
    2008 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1-9, 2008, : 3175 - +
  • [7] Supervised Remote Robot with Guided Autonomy and Teleoperation (SURROGATE): A Framework for Whole-Body Manipulation
    Hebert, Paul
    Ma, Jeremy
    Borders, James
    Aydemir, Alper
    Bajracharya, Max
    Hudson, Nicolas
    Shankar, Krishna
    Karumanchi, Sisir
    Douillard, Bertrand
    Burdick, Joel
    2015 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2015, : 5509 - 5516
  • [8] Object-Centered Hybrid Reasoning for Whole-Body Mobile Manipulation
    Leidner, Daniel
    Dietrich, Alexander
    Schmidt, Florian
    Borst, Christoph
    Albu-Schaeffer, Alin
    2014 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2014, : 1828 - 1835
  • [9] Articulated Object Interaction in Unknown Scenes with Whole-Body Mobile Manipulation
    Mittal, Mayank
    Hoeller, David
    Farshidian, Farbod
    Hutter, Marco
    Garg, Animesh
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 1647 - 1654
  • [10] Dynamic whole-body robotic manipulation
    Abe, Yeuhi
    Stephens, Benjamin
    Murphy, Michael P.
    Rizzi, Alfred A.
    UNMANNED SYSTEMS TECHNOLOGY XV, 2013, 8741