Task Space Control of Hydraulic Construction Machines Using Reinforcement Learning

被引:0
|
作者
Lee, Hyung Joo [1 ]
Brell-Cokcan, Sigrid [1 ]
机构
[1] Rhein Westfal TH Aachen, Chair Individualized Prod IP, Campus Blvd 30, D-52074 Aachen, Germany
来源
HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023 | 2024年 / 29卷
关键词
Reinforcement Learning; Construction Robot; Teleoperation;
D O I
10.1007/978-3-031-55000-3_13
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Teleoperation is vital in the construction industry, allowing safe machine manipulation from a distance. However, controlling machines at a joint level requires extensive training due to their complex degrees of freedom. Task space control offers intuitive maneuvering, but precise control often requires dynamic models, posing challenges for hydraulic machines. To address this, we use a data-driven actuator model to capture machine dynamics in real-world operations. By integrating this model into simulation and reinforcement learning, a control policy for task space control is obtained. A 3t hydraulic construction machine, Brokk 170, serves as the platform for implementing the proposed approach. Through a series of experiments, the framework's validity is established by comparing it against a well-established Jacobian-based approach.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 50 条
  • [1] Optimal robust online tracking control for space manipulator in task space using off-policy reinforcement learning
    Zhuang, Hongji
    Zhou, Hang
    Shen, Qiang
    Wu, Shufan
    Razoumny, Vladimir Yu.
    Razoumny, Yury N.
    AEROSPACE SCIENCE AND TECHNOLOGY, 2024, 153
  • [2] Reinforcement Learning for Disassembly Task Control
    Weerasekara, Sachini
    Li, Wei
    Isaacs, Jacqueline
    Kamarthi, Sagar
    COMPUTERS & INDUSTRIAL ENGINEERING, 2024, 190
  • [3] Reinforcement learning of a simple control task using the spike response model
    de Queiroz, Murilo Saraiva
    de Berredo, Roberto Coelho
    Braga, Antonio de Padua
    NEUROCOMPUTING, 2006, 70 (1-3) : 14 - 20
  • [4] Multi-agent reinforcement learning for redundant robot control in task-space
    Adolfo Perrusquía
    Wen Yu
    Xiaoou Li
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 231 - 241
  • [5] Multi-agent reinforcement learning for redundant robot control in task-space
    Perrusquia, Adolfo
    Yu, Wen
    Li, Xiaoou
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (01) : 231 - 241
  • [6] REINFORCEMENT LEARNING USING QUANTUM BOLTZMANN MACHINES
    Crawford, Daniel
    Levit, Anna
    Ghadermarzy, Navid
    Oberoi, Jaspreet S.
    Ronaghe, Pooya
    QUANTUM INFORMATION & COMPUTATION, 2018, 18 (1-2) : 51 - 74
  • [7] Intelligent Control of Construction Manufacturing Processes using Deep Reinforcement Learning
    Flood, Ian
    Flood, Paris D. L.
    PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON SIMULATION AND MODELING METHODOLOGIES, TECHNOLOGIES AND APPLICATIONS (SIMULTECH), 2022, : 112 - 122
  • [8] Motion control of a space manipulator using fuzzy sliding mode control with reinforcement learning
    Xie, Zhicheng
    Sun, Tao
    Kwan, Trevor
    Wu, Xiaofeng
    ACTA ASTRONAUTICA, 2020, 176 : 156 - 172
  • [9] Task Learning of a Task Robot in Real Space by Using a Learning System in Virtual Space
    Tsubone, Tadashi
    Kurimoto, Kenichi
    Sugiyama, Koichi
    Wada, Yasuhiro
    ELECTRICAL ENGINEERING IN JAPAN, 2010, 172 (01) : 38 - 47
  • [10] Enhanced Hydraulic Excavator Control via Semi-automatic Grading Control Using Reinforcement Learning
    Kim, Youngbum
    Kim, Jinwhan
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2025, 23 (03) : 896 - 906