Reinforcement Learning Based Speed Control with Creep Rate Constraints for Autonomous Driving of Mining Electric Locomotives

被引：1
|
作者：
Li, Ying [1 ]
Zhu, Zhencai [1 ]
Li, Xiaoqiang [2 ]
机构：
[1] China Univ Min & Technol, Sch Mech & Elect Engn, Xuzhou 221116, Peoples R China
[2] China Univ Min & Technol, Sch Elect Engn, Xuzhou 221116, Peoples R China
来源：
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 11期
关键词：
autonomous driving; creep rate; mining electric locomotive; reinforcement learning; speed control; FORCES;
D O I：
10.3390/app14114499
中图分类号：
O6 [化学];
学科分类号：
0703 ;
摘要：
The working environment of mining electric locomotives is wet and muddy coal mine roadway. Due to low friction between the wheel and rail and insufficient utilization of creep rate, there may be idling or slipping between the wheels and rails of mining electric locomotives. Therefore, it is necessary to control the creep rate within a reasonable range. In this paper, the autonomous control algorithm for mining electric locomotives based on improved epsilon-greedy is theoretically proven to be convergent and effective firstly. Secondly, after analyzing the contact state between the wheel and rail under wet and slippery road conditions, it is concluded that the value of creep rate is an important factor affecting the autonomous driving of mining electric locomotives. Therefore, the autonomous control method for mining electric locomotives based on creep control is proposed in this paper. Finally, the effectiveness of the proposed method is verified through simulation. The problem of wheel slipping and idling caused by insufficient friction of mining electric locomotives in coal mining environments is effectively suppressed. Autonomous operation of vehicles with optimal driving efficiency can be achieved through quantitative control and utilization of the creep rate between wheels and rails.
引用
收藏
页数：20
相关论文
共 50 条
  • [21] Recent advances in reinforcement learning-based autonomous driving behavior planning: A survey
    Wu, Jingda
    Huang, Chao
    Huang, Hailong
    Lv, Chen
    Wang, Yuntong
    Wang, Fei-Yue
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 164
  • [22] Safety-based Reinforcement Learning Longitudinal Decision for Autonomous Driving in Crosswalk Scenarios
    Xiong, Fangzhou
    Ren, Dongchun
    Fan, Mingyu
    Ding, Shuguang
    Liu, Zhiyong
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [23] Random Prior Network for Autonomous Driving Decision-Making Based on Reinforcement Learning
    Qiang, Yuchuan
    Wang, Xiaolan
    Wang, Yansong
    Zhang, Weiwei
    Xu, Jianxun
    JOURNAL OF TRANSPORTATION ENGINEERING PART A-SYSTEMS, 2024, 150 (04)
  • [24] Unity-Based Autonomous Driving Environment: A Platform for Validating Reinforcement Learning Agents
    Gonzalez-Santocildes, Asier
    Vazquez, Juan-Ignacio
    HYBRID ARTIFICIAL INTELLIGENT SYSTEMS, PT II, HAIS 2024, 2025, 14858 : 280 - 291
  • [25] A Decision-making Method for Longitudinal Autonomous Driving Based on Inverse Reinforcement Learning
    Gao Z.
    Yan X.
    Gao F.
    Qiche Gongcheng/Automotive Engineering, 2022, 44 (07): : 969 - 975
  • [26] Improved Reinforcement Learning through Imitation Learning Pretraining Towards Image-based Autonomous Driving
    Wang, Tianqi
    Chang, Dong Eui
    2019 19TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS 2019), 2019, : 1306 - 1310
  • [27] Learning Personalized Discretionary Lane-Change Initiation for Fully Autonomous Driving Based on Reinforcement Learning
    Liu, Zhuoxi
    Wang, Zheng
    Yang, Bo
    Nakano, Kimihiko
    2020 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2020, : 457 - 463
  • [28] Vision-Based Autonomous Driving: A Hierarchical Reinforcement Learning Approach
    Wang, Jiao
    Sun, Haoyi
    Zhu, Can
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (09) : 11213 - 11226
  • [29] Pre-training with asynchronous supervised learning for reinforcement learning based autonomous driving
    Wang, Yunpeng
    Zheng, Kunxian
    Tian, Daxin
    Duan, Xuting
    Zhou, Jianshan
    FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2021, 22 (05) : 673 - 686
  • [30] Augmenting Reinforcement Learning With Transformer-Based Scene Representation Learning for Decision-Making of Autonomous Driving
    Liu, Haochen
    Huang, Zhiyu
    Mo, Xiaoyu
    Lv, Chen
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (03): : 4405 - 4421
12345