Reinforcement Learning Based Speed Control with Creep Rate Constraints for Autonomous Driving of Mining Electric Locomotives

被引:1
|
作者
Li, Ying [1 ]
Zhu, Zhencai [1 ]
Li, Xiaoqiang [2 ]
机构
[1] China Univ Min & Technol, Sch Mech & Elect Engn, Xuzhou 221116, Peoples R China
[2] China Univ Min & Technol, Sch Elect Engn, Xuzhou 221116, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词
autonomous driving; creep rate; mining electric locomotive; reinforcement learning; speed control; FORCES;
D O I
10.3390/app14114499
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The working environment of mining electric locomotives is wet and muddy coal mine roadway. Due to low friction between the wheel and rail and insufficient utilization of creep rate, there may be idling or slipping between the wheels and rails of mining electric locomotives. Therefore, it is necessary to control the creep rate within a reasonable range. In this paper, the autonomous control algorithm for mining electric locomotives based on improved epsilon-greedy is theoretically proven to be convergent and effective firstly. Secondly, after analyzing the contact state between the wheel and rail under wet and slippery road conditions, it is concluded that the value of creep rate is an important factor affecting the autonomous driving of mining electric locomotives. Therefore, the autonomous control method for mining electric locomotives based on creep control is proposed in this paper. Finally, the effectiveness of the proposed method is verified through simulation. The problem of wheel slipping and idling caused by insufficient friction of mining electric locomotives in coal mining environments is effectively suppressed. Autonomous operation of vehicles with optimal driving efficiency can be achieved through quantitative control and utilization of the creep rate between wheels and rails.
引用
收藏
页数:20
相关论文
共 50 条
  • [41] Effect of Number of Lanes on Traffic Characteristics of Reinforcement Learning Based Autonomous Driving
    Aboyeji, Esther
    Ajani, Oladayo S.
    Mallipeddi, Rammohan
    IEEE ACCESS, 2023, 11 : 80199 - 80206
  • [42] A Study on an Enhanced Autonomous Driving Simulation Model Based on Reinforcement Learning Using a Collision Prevention Model
    Kim, Jong-Hoon
    Huh, Jun-Ho
    Jung, Se-Hoon
    Sim, Chun-Bo
    ELECTRONICS, 2021, 10 (18)
  • [43] Multi-Input Autonomous Driving Based on Deep Reinforcement Learning With Double Bias Experience Replay
    Cui, Jianping
    Yuan, Liang
    He, Li
    Xiao, Wendong
    Ran, Teng
    Zhang, Jianbo
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 11253 - 11261
  • [44] Comparison of Control Methods Based on Imitation Learning for Autonomous Driving
    Gao, Yinfeng
    Liu, Yuqi
    Zhang, Qichao
    Wang, Yu
    Zhao, Dongbin
    Ding, Dawei
    Pang, Zhonghua
    Zhang, Yueming
    2019 TENTH INTERNATIONAL CONFERENCE ON INTELLIGENT CONTROL AND INFORMATION PROCESSING (ICICIP), 2019, : 274 - 281
  • [45] Parallel Learning-Based Steering Control for Autonomous Driving
    Tian, Fangyin
    Li, Zhiheng
    Wang, Fei-Yue
    Li, Li
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (01): : 379 - 389
  • [46] A Learning-Based Framework for Velocity Control in Autonomous Driving
    Lefevre, Stephanie
    Carvalho, Ashwin
    Borrelli, Francesco
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2016, 13 (01) : 32 - 42
  • [47] End-to-end deep learning-based autonomous driving control for high-speed environment
    Cheol-jin Kim
    Myung-jae Lee
    Kyu-hong Hwang
    Young-guk Ha
    The Journal of Supercomputing, 2022, 78 : 1961 - 1982
  • [48] An Empirical Study of DDPG and PPO-Based Reinforcement Learning Algorithms for Autonomous Driving
    Siboo, Sanjna
    Bhattacharyya, Anushka
    Naveen Raj, Rashmi
    Ashwin, S. H.
    IEEE ACCESS, 2023, 11 : 125094 - 125108
  • [49] Stabilization Approaches for Reinforcement Learning-Based End-to-End Autonomous Driving
    Chen, Siyuan
    Wang, Meiling
    Song, Wenjie
    Yang, Yi
    Li, Yujun
    Fu, Mengyin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) : 4740 - 4750
  • [50] End-to-end deep learning-based autonomous driving control for high-speed environment
    Kim, Cheol-jin
    Lee, Myung-jae
    Hwang, Kyu-hong
    Ha, Young-guk
    JOURNAL OF SUPERCOMPUTING, 2022, 78 (02) : 1961 - 1982