Task Space Control of Hydraulic Construction Machines Using Reinforcement Learning

被引:0
作者
Lee, Hyung Joo [1 ]
Brell-Cokcan, Sigrid [1 ]
机构
[1] Rhein Westfal TH Aachen, Chair Individualized Prod IP, Campus Blvd 30, D-52074 Aachen, Germany
来源
HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023 | 2024年 / 29卷
关键词
Reinforcement Learning; Construction Robot; Teleoperation;
D O I
10.1007/978-3-031-55000-3_13
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Teleoperation is vital in the construction industry, allowing safe machine manipulation from a distance. However, controlling machines at a joint level requires extensive training due to their complex degrees of freedom. Task space control offers intuitive maneuvering, but precise control often requires dynamic models, posing challenges for hydraulic machines. To address this, we use a data-driven actuator model to capture machine dynamics in real-world operations. By integrating this model into simulation and reinforcement learning, a control policy for task space control is obtained. A 3t hydraulic construction machine, Brokk 170, serves as the platform for implementing the proposed approach. Through a series of experiments, the framework's validity is established by comparing it against a well-established Jacobian-based approach.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 20 条
[1]   Adaptive Backstepping Control of an Electrohydraulic Actuator [J].
Ahn, Kyoung Kwan ;
Doan Ngoc Chi Nam ;
Jin, Maolin .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2014, 19 (03) :987-995
[2]  
Brell-Cokcan S., 2022, Encyclopedia of Robotics, DOI DOI 10.1007/978-3-642-41610-1218-1
[3]  
Buss S. R., 2004, IEEE Journal of Robotics and Automation, V17, P16
[4]  
CHAN TF, 1995, IEEE T ROBOTIC AUTOM, V11, P286, DOI 10.1109/70.370511
[5]   Human performance issues and user interface design for teleoperated robots [J].
Chen, Jessie Y. C. ;
Haas, Ellen C. ;
Barnes, Michael J. .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2007, 37 (06) :1231-1245
[6]   Learning agile and dynamic motor skills for legged robots [J].
Hwangbo, Jemin ;
Lee, Joonho ;
Dosovitskiy, Alexey ;
Bellicoso, Dario ;
Tsounis, Vassilios ;
Koltun, Vladlen ;
Hutter, Marco .
SCIENCE ROBOTICS, 2019, 4 (26)
[7]   HEAP- The autonomous walking excavator [J].
Jud, Dominic ;
Kerscher, Simon ;
Wermelinger, Martin ;
Jelavic, Edo ;
Egli, Pascal ;
Leemann, Philipp ;
Hottiger, Gabriel ;
Hutter, Marco .
AUTOMATION IN CONSTRUCTION, 2021, 129
[8]   A UNIFIED APPROACH FOR MOTION AND FORCE CONTROL OF ROBOT MANIPULATORS - THE OPERATIONAL SPACE FORMULATION [J].
KHATIB, O .
IEEE JOURNAL OF ROBOTICS AND AUTOMATION, 1987, 3 (01) :43-53
[9]  
Lee H.J., 2022, P INT S AUT ROB CONS
[10]  
Lee H.J, 2023, Constr Robot, V7, P253, DOI [10.1007/s41693-023-00111-9, DOI 10.1007/S41693-023-00111-9]