Reinforcement Learning Based Speed Control with Creep Rate Constraints for Autonomous Driving of Mining Electric Locomotives

被引:1
|
作者
Li, Ying [1 ]
Zhu, Zhencai [1 ]
Li, Xiaoqiang [2 ]
机构
[1] China Univ Min & Technol, Sch Mech & Elect Engn, Xuzhou 221116, Peoples R China
[2] China Univ Min & Technol, Sch Elect Engn, Xuzhou 221116, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词
autonomous driving; creep rate; mining electric locomotive; reinforcement learning; speed control; FORCES;
D O I
10.3390/app14114499
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The working environment of mining electric locomotives is wet and muddy coal mine roadway. Due to low friction between the wheel and rail and insufficient utilization of creep rate, there may be idling or slipping between the wheels and rails of mining electric locomotives. Therefore, it is necessary to control the creep rate within a reasonable range. In this paper, the autonomous control algorithm for mining electric locomotives based on improved epsilon-greedy is theoretically proven to be convergent and effective firstly. Secondly, after analyzing the contact state between the wheel and rail under wet and slippery road conditions, it is concluded that the value of creep rate is an important factor affecting the autonomous driving of mining electric locomotives. Therefore, the autonomous control method for mining electric locomotives based on creep control is proposed in this paper. Finally, the effectiveness of the proposed method is verified through simulation. The problem of wheel slipping and idling caused by insufficient friction of mining electric locomotives in coal mining environments is effectively suppressed. Autonomous operation of vehicles with optimal driving efficiency can be achieved through quantitative control and utilization of the creep rate between wheels and rails.
引用
收藏
页数:20
相关论文
共 50 条
  • [31] Development of a Duct Cleaning Robot Algorithm Using Reinforcement Learning-based Autonomous Driving
    Yi, Sarang
    Noh, Eunsol
    Hong, Seokmoo
    TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2021, 45 (01) : 9 - 16
  • [32] A Reinforcement Learning Approach for Enacting Cautious Behaviours in Autonomous Driving System: Safe Speed Choice in the Interaction With Distracted Pedestrians
    Papini, Gastone Pietro Rosati
    Plebe, Alice
    Da Lio, Mauro
    Dona, Riccardo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 8805 - 8822
  • [33] Trust-Evaluation-Based Intrusion Detection and Reinforcement Learning in Autonomous Driving
    Xing, Rui
    Su, Zhou
    Zhang, Ning
    Peng, Yan
    Pu, Huayan
    Luo, Jun
    IEEE NETWORK, 2019, 33 (05): : 54 - 60
  • [34] A Hierarchical Framework for Multi-Lane Autonomous Driving Based on Reinforcement Learning
    Zhang, Xiaohui
    Sun, Jie
    Wang, Yunpeng
    Sun, Jian
    IEEE OPEN JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 4 : 626 - 638
  • [35] End-to-End Autonomous Driving Decision Based on Deep Reinforcement Learning
    Huang Z.-Q.
    Qu Z.-W.
    Zhang J.
    Zhang Y.-X.
    Tian R.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2020, 48 (09): : 1711 - 1719
  • [36] A Hybrid Machine Learning-based Control Strategy for Autonomous Driving Optimization
    Reda, Ahmad
    Benotsman, Rabab
    Bouzid, Ahmed
    Vasarhelyi, Jozsef
    ACTA POLYTECHNICA HUNGARICA, 2023, 20 (09) : 165 - 186
  • [37] Reinforcement Learning Based Overtaking Decision-Making for Highway Autonomous Driving
    Li, Xin
    Xu, Xin
    Zuo, Lei
    2015 SIXTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2015, : 336 - 342
  • [38] Prioritized Experience-Based Reinforcement Learning With Human Guidance for Autonomous Driving
    Wu, Jingda
    Huang, Zhiyu
    Huang, Wenhui
    Lv, Chen
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (01) : 855 - 869
  • [39] Autonomous driving planning and decision making based on game theory and reinforcement learning
    Duan, Weiping
    Tang, Zhongyi
    Liu, Wei
    Zhou, Hongbiao
    EXPERT SYSTEMS, 2023, 40 (05)
  • [40] Enhancing Autonomous Driving in Urban Scenarios: A Hybrid Approach with Reinforcement Learning and Classical Control
    Gutierrez-Moreno, Rodrigo
    Barea, Rafael
    Lopez-Guillen, Elena
    Arango, Felipe
    Sanchez-Garcia, Fabio
    Bergasa, Luis M.
    SENSORS, 2025, 25 (01)