SLP-Improved DDPG Path-Planning Algorithm for Mobile Robot in Large-Scale Dynamic Environment

被引:14
作者
Chen, Yinliang [1 ]
Liang, Liang [2 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Sch Power & Mech Engn, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
deep reinforcement learning; path planning; mobile robot; deep neural network;
D O I
10.3390/s23073521
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Navigating robots through large-scale environments while avoiding dynamic obstacles is a crucial challenge in robotics. This study proposes an improved deep deterministic policy gradient (DDPG) path planning algorithm incorporating sequential linear path planning (SLP) to address this challenge. This research aims to enhance the stability and efficiency of traditional DDPG algorithms by utilizing the strengths of SLP and achieving a better balance between stability and real-time performance. Our algorithm generates a series of sub-goals using SLP, based on a quick calculation of the robot's driving path, and then uses DDPG to follow these sub-goals for path planning. The experimental results demonstrate that the proposed SLP-enhanced DDPG path planning algorithm outperforms traditional DDPG algorithms by effectively navigating the robot through large-scale dynamic environments while avoiding obstacles. Specifically, the proposed algorithm improves the success rate by 12.33% compared to the traditional DDPG algorithm and 29.67% compared to the A*+DDPG algorithm in navigating the robot to the goal while avoiding obstacles.
引用
收藏
页数:15
相关论文
共 23 条
[11]   Path planning optimization of indoor mobile robot based on adaptive ant colony algorithm [J].
Miao, Changwei ;
Chen, Guangzhu ;
Yan, Chengliang ;
Wu, Yuanyuan .
COMPUTERS & INDUSTRIAL ENGINEERING, 2021, 156
[12]   Intelligent Reflecting Surface Enhanced Indoor Robot Path Planning: A Radio Map-Based Approach [J].
Mu, Xidong ;
Liu, Yuanwei ;
Guo, Li ;
Lin, Jiaru ;
Schober, Robert .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (07) :4732-4747
[13]   Indoor Robot Navigation Using Graph Models Based on BIM/IFC [J].
Palacz, Wojciech ;
Slusarczyk, Grazyna ;
Strug, Barbara ;
Grabska, Ewa .
ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2019, PT II, 2019, 11509 :654-665
[14]   Research on path planning algorithm of mobile robot based on reinforcement learning [J].
Pan, Guoqian ;
Xiang, Yong ;
Wang, Xiaorui ;
Yu, Zhongquan ;
Zhou, Xinzhi .
SOFT COMPUTING, 2022, 26 (18) :8961-8970
[15]   A novel mobile robot navigation method based on deep reinforcement learning [J].
Quan, Hao ;
Li, Yansheng ;
Zhang, Yi .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03)
[16]  
Sun Nico, 2019, Towards Autonomous Robotic Systems. 20th Annual Conference, TAROS 2019. Proceedings: Lecture Notes in Artificial Intelligence (LNAI 11650), P191, DOI 10.1007/978-3-030-25332-5_17
[17]  
TImothy P.Lillicrap., 2016, CONTINUOUS CONTROL D
[18]   Path Planning for Mobile Robot Navigation in Unknown Indoor Environments Using Hybrid PSOFS Algorithm [J].
Wahab, Mohd Nadhir Ab ;
Lee, Ching May ;
Akbar, Muhammad Firdaus ;
Hassan, Fadratul Hafinaz .
IEEE ACCESS, 2020, 8 :161805-161815
[19]   Mobile Robot Path Planning in Dynamic Environments Through Globally Guided Reinforcement Learning [J].
Wang, Binyu ;
Liu, Zhe ;
Li, Qingbiao ;
Prorok, Amanda .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (04) :6932-6939
[20]   RETRACTED: Robot Path Planning Method Based on Indoor Spacetime Grid Model (Retracted Article) [J].
Zhang, Huangchuang ;
Zhuang, Qingjun ;
Li, Ge .
REMOTE SENSING, 2022, 14 (10)