Task Space Control of Hydraulic Construction Machines Using Reinforcement Learning

被引:0
|
作者
Lee, Hyung Joo [1 ]
Brell-Cokcan, Sigrid [1 ]
机构
[1] Rhein Westfal TH Aachen, Chair Individualized Prod IP, Campus Blvd 30, D-52074 Aachen, Germany
来源
HUMAN-FRIENDLY ROBOTICS 2023, HFR 2023 | 2024年 / 29卷
关键词
Reinforcement Learning; Construction Robot; Teleoperation;
D O I
10.1007/978-3-031-55000-3_13
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Teleoperation is vital in the construction industry, allowing safe machine manipulation from a distance. However, controlling machines at a joint level requires extensive training due to their complex degrees of freedom. Task space control offers intuitive maneuvering, but precise control often requires dynamic models, posing challenges for hydraulic machines. To address this, we use a data-driven actuator model to capture machine dynamics in real-world operations. By integrating this model into simulation and reinforcement learning, a control policy for task space control is obtained. A 3t hydraulic construction machine, Brokk 170, serves as the platform for implementing the proposed approach. Through a series of experiments, the framework's validity is established by comparing it against a well-established Jacobian-based approach.
引用
收藏
页码:181 / 195
页数:15
相关论文
共 50 条
  • [21] Reinforcement learning for energy-efficient control of parallel and identical machines
    Loffredo, Alberto
    May, Marvin Carl
    Schaefer, Louis
    Matta, Andrea
    Lanza, Gisela
    CIRP JOURNAL OF MANUFACTURING SCIENCE AND TECHNOLOGY, 2023, 44 : 91 - 103
  • [22] Open-Loop Motion Control of a Hydraulic Soft Robotic Arm Using Deep Reinforcement Learning
    Zhang, Yunce
    Wang, Tao
    Tan, Ning
    Zhu, Shiqiang
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2021, PT I, 2021, 13013 : 302 - 312
  • [23] A Deep Reinforcement Learning Approach to Injection Speed Control in Injection Molding Machines with Servomotor-Driven Constant Pump Hydraulic System
    Ren, Zhigang
    Tang, Peng
    Zheng, Wen
    Zhang, Bo
    ACTUATORS, 2024, 13 (09)
  • [24] Learning Path Construction Using Reinforcement Learning and Bloom's Taxonomy
    Kim, Seounghun
    Kim, Woojin
    Kim, Hyeoncheol
    INTELLIGENT TUTORING SYSTEMS (ITS 2021), 2021, 12677 : 267 - 278
  • [25] Task Offloading in Computing Continuum Using Collaborative Reinforcement Learning
    Robles-Enciso, Alberto
    Skarmeta, Antonio F.
    INTERNET OF THINGS, GIOTS 2022, 2022, 13533 : 82 - 95
  • [26] Task distribution and human resource management using reinforcement learning
    Paduraru, Ciprian
    Paduraru, Miruna
    Camelia Patilea, Catalina
    2021 36TH IEEE/ACM INTERNATIONAL CONFERENCE ON AUTOMATED SOFTWARE ENGINEERING WORKSHOPS (ASEW 2021), 2021, : 96 - 101
  • [27] Reinforcement Learning in Continuous Time and Space: A Stochastic Control Approach
    Wang, Haoran
    Zariphopoulou, Thaleia
    Zhou, Xun Yu
    JOURNAL OF MACHINE LEARNING RESEARCH, 2020, 21
  • [28] Versatile Control of Fluid-directed Solid Objects Using Multi-task Reinforcement Learning
    Ren, Bo
    Ye, Xiaohan
    Pan, Zherong
    Zhang, Taiyuan
    ACM TRANSACTIONS ON GRAPHICS, 2023, 42 (02):
  • [29] Experiments of conditioned reinforcement learning in continuous space control tasks
    Fernandez-Gauna, Borja
    Osa, Juan Luis
    Grana, Manuel
    NEUROCOMPUTING, 2018, 271 : 38 - 47
  • [30] Performance based thermal comfort control (PTCC) using deep reinforcement learning for space cooling
    Yoon, Young Ran
    Moon, Hyeun Jun
    ENERGY AND BUILDINGS, 2019, 203