SLP-Improved DDPG Path-Planning Algorithm for Mobile Robot in Large-Scale Dynamic Environment

被引:14
作者
Chen, Yinliang [1 ]
Liang, Liang [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Sch Power & Mech Engn, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; path planning; mobile robot; deep neural network;
D O I
10.3390/s23073521
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Navigating robots through large-scale environments while avoiding dynamic obstacles is a crucial challenge in robotics. This study proposes an improved deep deterministic policy gradient (DDPG) path planning algorithm incorporating sequential linear path planning (SLP) to address this challenge. This research aims to enhance the stability and efficiency of traditional DDPG algorithms by utilizing the strengths of SLP and achieving a better balance between stability and real-time performance. Our algorithm generates a series of sub-goals using SLP, based on a quick calculation of the robot's driving path, and then uses DDPG to follow these sub-goals for path planning. The experimental results demonstrate that the proposed SLP-enhanced DDPG path planning algorithm outperforms traditional DDPG algorithms by effectively navigating the robot through large-scale dynamic environments while avoiding obstacles. Specifically, the proposed algorithm improves the success rate by 12.33% compared to the traditional DDPG algorithm and 29.67% compared to the A*+DDPG algorithm in navigating the robot to the goal while avoiding obstacles.
引用
收藏
页数:15
相关论文
共 23 条
[1]   Artificial Potential Field with Discrete Map Transformation for Feasible Indoor Path Planning [J].
Azmi, Muhammad Zulfaqar ;
Ito, Toshio .
APPLIED SCIENCES-BASEL, 2020, 10 (24) :1-13
[2]   Optimal path planning and execution for mobile robots using genetic algorithm and adaptive fuzzy-logic control [J].
Bakdi, Azzeddine ;
Hentout, Abdelfetah ;
Boutami, Hakim ;
Maoudj, Abderraouf ;
Hachour, Ouarda ;
Bouzouia, Brahim .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 89 :95-109
[3]   A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance [J].
Chen, Pengzhan ;
Pei, Jiean ;
Lu, Weiqing ;
Li, Mingzhen .
NEUROCOMPUTING, 2022, 497 :64-75
[4]   A novel whale optimization algorithm of path planning strategy for mobile robots [J].
Dai, Yaonan ;
Yu, Jiuyang ;
Zhang, Cong ;
Zhan, Bowen ;
Zheng, Xiaotao .
APPLIED INTELLIGENCE, 2023, 53 (09) :10843-10857
[5]   Using the Bees Algorithm for wheeled mobile robot path planning in an indoor dynamic environment [J].
Darwish, Ahmed Haj ;
Joukhadar, Abdulkader ;
Kashkash, Mariam .
COGENT ENGINEERING, 2018, 5 (01)
[6]   Enhancing Path Quality of Real-Time Path Planning Algorithms for Mobile Robots: A Sequential Linear Paths Approach [J].
Fareh, Raouf ;
Baziyad, Mohammed ;
Rabie, Tamer ;
Bettayeb, Maamar .
IEEE ACCESS, 2020, 8 :167090-167104
[7]   Efficient Path Planning for Mobile Robot Based on Deep Deterministic Policy Gradient [J].
Gong, Hui ;
Wang, Peng ;
Ni, Cui ;
Cheng, Nuo .
SENSORS, 2022, 22 (09)
[8]   Path planning of mobile robot in unknown dynamic continuous environment using reward-modified deep Q-network [J].
Huang, Runnan ;
Qin, Chengxuan ;
Li, Jian Ling ;
Lan, Xuejing .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2023, 44 (03) :1570-1587
[9]   Complete coverage path planning using reinforcement learning for Tetromino based cleaning and maintenance robot [J].
Lakshmanan, Anirudh Krishna ;
Elara, Mohan Rajesh ;
Ramalingam, Balakrishnan ;
Anh Vu Le ;
Veerajagadeshwar, Prabahar ;
Tiwari, Kamlesh ;
Ilyas, Muhammad .
AUTOMATION IN CONSTRUCTION, 2020, 112
[10]   Modified Q-learning with distance metric and virtual target on path planning of mobile robot [J].
Low, Ee Soong ;
Ong, Pauline ;
Low, Cheng Yee ;
Omar, Rosli .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 199