Task Space Control of Hydraulic Construction Machines Using Reinforcement Learning

被引:0
|
作者
Lee, Hyung Joo [1 ]
Brell-Cokcan, Sigrid [1 ]
机构
[1] Rhein Westfal TH Aachen, Chair Individualized Prod IP, Campus Blvd 30, D-52074 Aachen, Germany
来源
HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023 | 2024年 / 29卷
关键词
Reinforcement Learning; Construction Robot; Teleoperation;
D O I
10.1007/978-3-031-55000-3_13
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Teleoperation is vital in the construction industry, allowing safe machine manipulation from a distance. However, controlling machines at a joint level requires extensive training due to their complex degrees of freedom. Task space control offers intuitive maneuvering, but precise control often requires dynamic models, posing challenges for hydraulic machines. To address this, we use a data-driven actuator model to capture machine dynamics in real-world operations. By integrating this model into simulation and reinforcement learning, a control policy for task space control is obtained. A 3t hydraulic construction machine, Brokk 170, serves as the platform for implementing the proposed approach. Through a series of experiments, the framework's validity is established by comparing it against a well-established Jacobian-based approach.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 50 条
  • [41] A Resource-efficient Task Scheduling System using Reinforcement Learning
    Morchdi, Chedi
    Chiu, Cheng-Hsiang
    Zhou, Yi
    Huang, Tsung-Wei
    29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 89 - 95
  • [42] Autonomous Construction of Structures in a Dynamic Environment using Reinforcement Learning
    Barros dos Santos, Sergio Ronaldo
    Givigi, Sidney N., Jr.
    Nascimento Junior, Cairo Lucio
    2013 7TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE (SYSCON 2013), 2013, : 452 - 459
  • [43] Offline reinforcement learning with task hierarchies
    Devin Schwab
    Soumya Ray
    Machine Learning, 2017, 106 : 1569 - 1598
  • [44] Control strategy of robotic manipulator based on multi-task reinforcement learning
    Wang, Tao
    Ruan, Ziming
    Wang, Yuyan
    Chen, Chong
    COMPLEX & INTELLIGENT SYSTEMS, 2025, 11 (03)
  • [45] Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning
    Zhang, Lu
    Zhang, Zi-Yan
    Min, Luo
    Tang, Chao
    Zhang, Hong-Ying
    Wang, Ya-Hong
    Cai, Peng
    IEEE ACCESS, 2021, 9 : 53708 - 53719
  • [46] Offline reinforcement learning with task hierarchies
    Schwab, Devin
    Ray, Soumya
    MACHINE LEARNING, 2017, 106 (9-10) : 1569 - 1598
  • [47] HeuRL: A Heuristically Initialized Reinforcement Learning Method for Autonomous Driving Control Task
    Xu, Jiaxuan
    Yuan, Jian
    2018 INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTS (ICCR), 2018, : 57 - 62
  • [48] A Reinforcement Learning Approach in Assignment of Task Priorities in Kinematic Control of Redundant Robots
    Karimi, Masoud
    Ahmadi, Mojtaba
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 850 - 857
  • [49] Robotic Disassembly Task Training and Skill Transfer Using Reinforcement Learning
    Qu, Mo
    Wang, Yongjing
    Pham, Duc Truong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 10934 - 10943
  • [50] Towards Multi-agent Reinforcement Learning using Quantum Boltzmann Machines
    Mueller, Tobias
    Roch, Christoph
    Schmid, Kyrill
    Altmann, Philipp
    ICAART: PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE - VOL 1, 2022, : 121 - 130