Task Space Control of Hydraulic Construction Machines Using Reinforcement Learning

被引:0
|
作者
Lee, Hyung Joo [1 ]
Brell-Cokcan, Sigrid [1 ]
机构
[1] Rhein Westfal TH Aachen, Chair Individualized Prod IP, Campus Blvd 30, D-52074 Aachen, Germany
来源
HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023 | 2024年 / 29卷
关键词
Reinforcement Learning; Construction Robot; Teleoperation;
D O I
10.1007/978-3-031-55000-3_13
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Teleoperation is vital in the construction industry, allowing safe machine manipulation from a distance. However, controlling machines at a joint level requires extensive training due to their complex degrees of freedom. Task space control offers intuitive maneuvering, but precise control often requires dynamic models, posing challenges for hydraulic machines. To address this, we use a data-driven actuator model to capture machine dynamics in real-world operations. By integrating this model into simulation and reinforcement learning, a control policy for task space control is obtained. A 3t hydraulic construction machine, Brokk 170, serves as the platform for implementing the proposed approach. Through a series of experiments, the framework's validity is established by comparing it against a well-established Jacobian-based approach.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 50 条
  • [31] Lateral Control of a Vehicle using Reinforcement Learning
    Brasch, Moritz
    Heinz, Ipek Sarac
    Bayer, Alexander
    2022 8TH INTERNATIONAL CONFERENCE ON CONTROL, DECISION AND INFORMATION TECHNOLOGIES (CODIT'22), 2022, : 451 - 456
  • [32] Robot control optimization using reinforcement learning
    Song, KT
    Sun, WY
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 1998, 21 (03) : 221 - 238
  • [33] Traffic Signal Control Using Reinforcement Learning
    Jadhao, Namrata S.
    Jadhao, Ashish S.
    2014 FOURTH INTERNATIONAL CONFERENCE ON COMMUNICATION SYSTEMS AND NETWORK TECHNOLOGIES (CSNT), 2014, : 1130 - 1135
  • [34] Robot Control Optimization Using Reinforcement Learning
    Kai-Tai Song
    Wen-Yu Sun
    Journal of Intelligent and Robotic Systems, 1998, 21 : 221 - 238
  • [35] Control of A Polyol Process Using Reinforcement Learning
    Zhu, Wenbo
    Rendall, Ricardo
    Castillo, Ivan
    Wang, Zhenyu
    Chiang, Leo H.
    Hayot, Philippe
    Romagnoli, Jose A.
    IFAC PAPERSONLINE, 2021, 54 (03): : 498 - 503
  • [36] Control of Qubit Dynamics Using Reinforcement Learning
    Koutromanos, Dimitris
    Stefanatos, Dionisis
    Paspalakis, Emmanuel
    INFORMATION, 2024, 15 (05)
  • [37] A General Approach for the Automation of Hydraulic Excavator Arms Using Reinforcement Learning
    Egli, Pascal
    Hutter, Marco
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02): : 5679 - 5686
  • [38] Goal-directed graph construction using reinforcement learning
    Darvariu, Victor-Alexandru
    Hailes, Stephen
    Musolesi, Mirco
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2021, 477 (2254):
  • [39] A reinforcement learning algorithm acquires demonstration from the training agent by dividing the task space
    Zu, Lipeng
    He, Xiao
    Yang, Jia
    Liu, Lianqing
    Wang, Wenxue
    NEURAL NETWORKS, 2023, 164 : 419 - 427
  • [40] An Intelligent Control System Construction Using High-level Time Petri Net And Reinforcement Learning
    Feng, Liangbing
    Obayashi, Masanao
    Kuremoto, Takashi
    Kobayashi, Kunikazu
    INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2010), 2010, : 535 - 539