Learning Whole-Body Manipulation for Quadrupedal Robot

被引:11
作者
Jeon, Seunghun [1 ]
Jung, Moonkyu [1 ]
Choi, Suyoung [1 ]
Kim, Beomjoon [2 ]
Hwangbo, Jemin [1 ]
机构
[1] Korea Adv Inst Sci & Technol, Robot & Artificial Intelligence Lab, Dept Mech Engn, Daejeon 34141, South Korea
[2] Korea Adv Inst Sci & Technol, Dept Kim Jaechul Grad Sch AI, Intelligent Mobile Manipulat Lab, Seoul 02455, South Korea
关键词
Deep learning methods; legged robots; reinforcement learning; LOCOMOTION;
D O I
10.1109/LRA.2023.3335777
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
We propose a learning-based system for enablingquadrupedal robots to manipulate large, heavy objects using theiwhole body. Our system is based on a hierarchical control strategy that uses the deep latent variable embedding which capturesmanipulation-relevant information from interactions, propriocep-tion, and action history, allowing the robot to implicitly understandobject properties. We evaluate our framework in both simulationand real-world scenarios. In the simulation, it achieves a successrate of 93.6%in accurately re-positioning and re-orienting variousobjects within a tolerance of 0.03 m and 5 degrees. Real-world experimentsdemonstratethesuccessfulmanipulationofobjectssuchasa19.2kgwater-filled drum and a 15.3 kg plastic box filled with heavy objects while the robot weighs 27 kg. Unlike previous works that focus onmani pulating small and light objects using prehensile manipulation, our framework illustrates the possibility of using quadrupeds for manipulating large and heavy objects that are ungraspable with the robot's entire body. Our method does not require explicit object modeling and offers significant computational efficiency comparedto optimization-based methods.
引用
收藏
页码:699 / 706
页数:8
相关论文
共 33 条
[1]   Transferring Dexterous Manipulation from GPU Simulation to a Remote Real-World TriFinger [J].
Allshire, Arthur ;
Mittal, Mayank ;
Lodaya, Varun ;
Makoviychuk, Viktor ;
Makoviichuk, Denys ;
Widmaier, Felix ;
Wuthrich, Manuel ;
Bauer, Stefan ;
Handa, Ankur ;
Garg, Animesh .
2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, :11802-11809
[2]   DreamWaQ: Learning Robust Quadrupedal Locomotion With Implicit Terrain Imagination via Deep Reinforcement Learning [J].
Nahrendra, I. Made Aswin ;
Yu, Byeongho ;
Myung, Hyun .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, :5078-5084
[3]   ALMA - Articulated Locomotion and Manipulation for a Torque-Controllable Robot [J].
Bellicoso, C. Dario ;
Kramer, Koen ;
Stauble, Markus ;
Sako, Dhionis ;
Jenelten, Fabian ;
Bjelonic, Marko ;
Hutter, Marco .
2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, :8477-8483
[4]   Humanoid Robot Locomotion and Manipulation Step Planning [J].
Bouyarmane, Karim ;
Kheddar, Abderrahmane .
ADVANCED ROBOTICS, 2012, 26 (10) :1099-1126
[5]   Legs as Manipulator: Pushing Quadrupedal Agility Beyond Locomotion [J].
Cheng, Xuxin ;
Kumar, Ashish ;
Pathak, Deepak .
2023 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, ICRA, 2023, :5106-5112
[6]   Learning quadrupedal locomotion on deformable terrain [J].
Choi, Suyoung ;
Ji, Gwanghyeon ;
Park, Jeongsoo ;
Kim, Hyeongjun ;
Mun, Juhyeok ;
Lee, Jeong Hyun ;
Hwangbo, Jemin .
SCIENCE ROBOTICS, 2023, 8 (74)
[7]   Depression and loneliness symptoms in Brazilian older people during the COVID-19 pandemic: a network approach [J].
Ferreira, Heloisa Goncalves ;
Franca, Alex Bacadini .
AGING & MENTAL HEALTH, 2023, 27 (12) :2474-2481
[8]  
Fu Z., 2023, PMLR, P138
[9]   Per-Contact Iteration Method for Solving Contact Dynamics [J].
Hwangbo, Jemin ;
Lee, Joonho ;
Hutter, Marco .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (02) :895-902
[10]   Concurrent Training of a Control Policy and a State Estimator for Dynamic and Robust Legged Locomotion [J].
Ji, Gwanghyeon ;
Mun, Juhyeok ;
Kim, Hyeongjun ;
Hwangbo, Jemin .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) :4630-4637