Improved reinforcement learning path planning algorithm integrating prior knowledge

被引:4
|
作者
Shi, Zhen [1 ,2 ]
Wang, Keyin [1 ,2 ]
Zhang, Jianhui [1 ,2 ]
机构
[1] Hubei Univ Automot Technol, Sch Automot Engn, Shiyan, Hubei, Peoples R China
[2] Hubei Univ Automot Technol, Key Lab Automot Power Train & Elect, Shiyan, Hubei, Peoples R China
来源
PLOS ONE | 2023年 / 18卷 / 05期
关键词
D O I
10.1371/journal.pone.0284942
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In order to realize the optimization of autonomous navigation of mobile robot under the condition of partial environmental knowledge known. An improved Q-learning reinforcement learning algorithm based on prior knowledge is proposed to solve the problem of slow convergence and low learning efficiency in mobile robot path planning. Prior knowledge is used to initialize the Q-value, so as to guide the agent to move toward the target direction with a greater probability from the early stage of the algorithm, eliminating a large number of invalid iterations. The greedy factor epsilon is dynamically adjusted based on the number of times the agent successfully reaches the target position, so as to better balance exploration and exploitation and accelerate convergence. Simulation results show that the improved Q-learning algorithm has a faster convergence rate and higher learning efficiency than the traditional algorithm. The improved algorithm has practical significance for improving the efficiency of autonomous navigation of mobile robots.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Path planning in an unknown environment based on deep reinforcement learning with prior knowledge
    Lou, Ping
    Xu, Kun
    Jiang, Xuemei
    Xiao, Zheng
    Yan, Junwei
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2021, 41 (06) : 5773 - 5789
  • [2] Path planning for mobile robot based on improved reinforcement learning algorithm
    Xu X.
    Yuan J.
    Zhongguo Guanxing Jishu Xuebao/Journal of Chinese Inertial Technology, 2019, 27 (03): : 314 - 320
  • [3] An Improved Deep Reinforcement Learning Algorithm for Path Planning in Unmanned Driving
    Yang, Kai
    Liu, Li
    IEEE ACCESS, 2024, 12 : 67935 - 67944
  • [4] Path Planning of Robotic Fish in Unknown Environment with Improved Reinforcement Learning Algorithm
    Hu, Jingbo
    Mei, Jie
    Chen, Dingfang
    Li, Lijie
    Cheng, Zhengshu
    INTERNET AND DISTRIBUTED COMPUTING SYSTEMS, 2018, 11226 : 248 - 257
  • [5] Mobile Robot Path Planning Based on Improved DDPG Reinforcement Learning Algorithm
    Dong, Yuansheng
    Zou, Xingjie
    PROCEEDINGS OF 2020 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING AND SERVICE SCIENCE (ICSESS 2020), 2020, : 52 - 55
  • [6] Improved A* Path Planning Algorithm Integrating Bezier Curves
    Jin, Rencai
    Wang, Pengjie
    Qian, Yuandi
    Li, Dan
    Gong, Xu
    Zhao, Wenjie
    Fu, Jingang
    2024 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS, ICARM 2024, 2024, : 885 - 890
  • [7] Robot path planning algorithm based on reinforcement learning
    Zhang F.
    Li N.
    Yuan R.
    Fu Y.
    Huazhong Keji Daxue Xuebao (Ziran Kexue Ban)/Journal of Huazhong University of Science and Technology (Natural Science Edition), 2018, 46 (12): : 65 - 70
  • [8] Research on AGV Path Planning Integrating an Improved A* Algorithm and DWA Algorithm
    Sang, Wenpeng
    Yue, Yaoshun
    Zhai, Kaiwei
    Lin, Maohai
    APPLIED SCIENCES-BASEL, 2024, 14 (17):
  • [9] A configuration of multi-agent reinforcement learning integrating prior knowledge
    Tang, Hainan
    Tang, Hongjie
    Liu, Juntao
    Rao, Ziyun
    Zhang, Yunshu
    Luo, Xunhao
    2024 2ND ASIA CONFERENCE ON COMPUTER VISION, IMAGE PROCESSING AND PATTERN RECOGNITION, CVIPPR 2024, 2024,
  • [10] UCAV Path Planning Algorithm Based on Deep Reinforcement Learning
    Zheng, Kaiyuan
    Gao, Jingpeng
    Shen, Liangxi
    IMAGE AND GRAPHICS, ICIG 2019, PT II, 2019, 11902 : 702 - 714