Reinforcement Learning Based Speed Control with Creep Rate Constraints for Autonomous Driving of Mining Electric Locomotives

被引:1
|
作者
Li, Ying [1 ]
Zhu, Zhencai [1 ]
Li, Xiaoqiang [2 ]
机构
[1] China Univ Min & Technol, Sch Mech & Elect Engn, Xuzhou 221116, Peoples R China
[2] China Univ Min & Technol, Sch Elect Engn, Xuzhou 221116, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词
autonomous driving; creep rate; mining electric locomotive; reinforcement learning; speed control; FORCES;
D O I
10.3390/app14114499
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The working environment of mining electric locomotives is wet and muddy coal mine roadway. Due to low friction between the wheel and rail and insufficient utilization of creep rate, there may be idling or slipping between the wheels and rails of mining electric locomotives. Therefore, it is necessary to control the creep rate within a reasonable range. In this paper, the autonomous control algorithm for mining electric locomotives based on improved epsilon-greedy is theoretically proven to be convergent and effective firstly. Secondly, after analyzing the contact state between the wheel and rail under wet and slippery road conditions, it is concluded that the value of creep rate is an important factor affecting the autonomous driving of mining electric locomotives. Therefore, the autonomous control method for mining electric locomotives based on creep control is proposed in this paper. Finally, the effectiveness of the proposed method is verified through simulation. The problem of wheel slipping and idling caused by insufficient friction of mining electric locomotives in coal mining environments is effectively suppressed. Autonomous operation of vehicles with optimal driving efficiency can be achieved through quantitative control and utilization of the creep rate between wheels and rails.
引用
收藏
页数:20
相关论文
共 50 条
  • [1] An improved ε-greedy strategy based reinforcement learning for autonomous control of mining electric locomotives
    Li, Ying
    Zhu, Zhencai
    Li, Xiaoqiang
    Yang, Chunyu
    Lu, Hao
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART I-JOURNAL OF SYSTEMS AND CONTROL ENGINEERING, 2024,
  • [2] Path tracking control based on Deep reinforcement learning in Autonomous driving
    Jiang, Le
    Wang, Yafei
    Wang, Lin
    Wu, Jingkai
    2019 3RD CONFERENCE ON VEHICLE CONTROL AND INTELLIGENCE (CVCI), 2019, : 414 - 419
  • [3] Safe, efficient, and comfortable velocity control based on reinforcement learning for autonomous driving
    Zhu, Meixin
    Wang, Yinhai
    Pu, Ziyuan
    Hu, Jingyun
    Wang, Xuesong
    Ke, Ruimin
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2020, 117
  • [4] Constraints Driven Safe Reinforcement Learning for Autonomous Driving Decision-Making
    Gao, Fei
    Wang, Xiaodong
    Fan, Yuze
    Gao, Zhenhai
    Zhao, Rui
    IEEE ACCESS, 2024, 12 : 128007 - 128023
  • [5] A Decision Control Method for Autonomous Driving Based on Multi-Task Reinforcement Learning
    Cai, Yingfeng
    Yang, Shaoqing
    Wang, Hai
    Teng, Chenglong
    Chen, Long
    IEEE ACCESS, 2021, 9 (09): : 154553 - 154562
  • [6] Reinforcement-Learning-Based Trajectory Learning in Frenet Frame for Autonomous Driving
    Yoon, Sangho
    Kwon, Youngjoon
    Ryu, Jaesung
    Kim, Sungkwan
    Choi, Sungwoo
    Lee, Kyungjae
    APPLIED SCIENCES-BASEL, 2024, 14 (16):
  • [7] Deep Reinforcement Learning for Autonomous Driving Based on Safety Experience Replay
    Huang, Xiaohan
    Cheng, Yuhu
    Yu, Qiang
    Wang, Xuesong
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2024, 16 (06) : 2070 - 2084
  • [8] Reinforcement Learning-Based Autonomous Driving at Intersections in CARLA Simulator
    Gutierrez-Moreno, Rodrigo
    Barea, Rafael
    Lopez-Guillen, Elena
    Araluce, Javier
    Bergasa, Luis M.
    SENSORS, 2022, 22 (21)
  • [9] Reinforcement Learning-Based High-Speed Path Following Control for Autonomous Vehicles
    Liu, Jia
    Cui, Yunduan
    Duan, Jianghua
    Jiang, Zhengmin
    Pan, Zhongming
    Xu, Kun
    Li, Huiyun
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (06) : 7603 - 7615
  • [10] HeuRL: A Heuristically Initialized Reinforcement Learning Method for Autonomous Driving Control Task
    Xu, Jiaxuan
    Yuan, Jian
    2018 INTERNATIONAL CONFERENCE ON CONTROL AND ROBOTS (ICCR), 2018, : 57 - 62