DP-A*: For Path Planing of UGV and Contactless Delivery

被引:19
作者
Gan, Xingli [1 ]
Huo, Zhihui [1 ]
Li, Wei [2 ]
机构
[1] Zhejiang Univ Sci & Technol, Sch Informat & Elect Engn, Hangzhou 310023, Peoples R China
[2] Chinese Acad Sci, Natl Time Serv Ctr, Xian 710600, Peoples R China
关键词
Path planning; Robots; Heuristic algorithms; Task analysis; Planning; Classification algorithms; Collision avoidance; unmanned logistics; contactless delivery; reinforcement learning; A-Star; Q-learning; robotics; PARTICLE SWARM OPTIMIZATION; ALGORITHM; ONLINE; SLAM;
D O I
10.1109/TITS.2023.3258186
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The unmanned logistics and distribution urgently require a large number of unmanned ground vehicles(UGVs) under the influence of the potential spread of the Coronavirus Disease 2019 (COVID-19). The path planning of UGV relies excessively on SLAM map, and has no self-optimization and learning ability for the space containing a large number of unknown obstacles. In this paper, a new dynamic parameter-A* (DP-A*) algorithm is proposed, which is based on the A* algorithm and enables the UGV to continuously optimize the path while performing the same task repeatedly. First, the original evaluation functions of the A* algorithm are modified by Q-Learning to memory the coordinates of unknown obstacle. Then, Q-table is adopted as an auxiliary guidance for recording the characteristics of environmental changes and generating heuristic factor to overcome the shortcoming of the A* algorithm. At last, the DP-A* algorithm can realize path planning in the instantaneous changing environment, record the actual situation of obstacles encountered, and gradually optimize the path in the task that needs multiple explorations. By several simulations with different characteristics, it is shown that our algorithm outperforms Q-learning, Sarsa and A* according to the evaluation criteria such as convergence speed, memory systems consume, Optimization ability of path planning and dynamic learning ability.
引用
收藏
页码:907 / 919
页数:13
相关论文
共 43 条
[1]   Modified Flower Pollination Algorithm for Global Optimization [J].
Abdel-Basset, Mohamed ;
Mohamed, Reda ;
Saber, Safaa ;
Askar, S. S. ;
Abouhawwash, Mohamed .
MATHEMATICS, 2021, 9 (14)
[2]   Conditional DQN-Based Motion Planning With Fuzzy Logic for Autonomous Driving [J].
Chen, Long ;
Hu, Xuemin ;
Tang, Bo ;
Cheng, Yu .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (04) :2966-2977
[3]   Intelligent-based multi-robot path planning inspired by improved classical Q-learning and improved particle swarm optimization with perturbed velocity [J].
Das, P. K. ;
Behera, H. S. ;
Panigrahi, B. K. .
ENGINEERING SCIENCE AND TECHNOLOGY-AN INTERNATIONAL JOURNAL-JESTECH, 2016, 19 (01) :651-669
[4]   COP-SLAM: Closed-Form Online Pose-Chain Optimization for Visual SLAM [J].
Dubbelman, Gijs ;
Browning, Brett .
IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (05) :1194-1213
[5]   Sampling-Based Robot Motion Planning: A Review [J].
Elbanhawi, Mohamed ;
Simic, Milan .
IEEE ACCESS, 2014, 2 :56-77
[6]   Obstacle Avoidance for Microrobots in Simulated Vascular Environment Based on Combined Path Planning [J].
Fan, Qigao ;
Cui, Guangming ;
Zhao, Zhengqing ;
Shen, Jun .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) :9801-9808
[7]   Using interpolation to improve path planning:: The field D* algorithm [J].
Ferguson, Dave ;
Stentz, Anthony .
JOURNAL OF FIELD ROBOTICS, 2006, 23 (02) :79-101
[8]   An improved A* algorithm for the industrial robot path planning with high success rate and short length [J].
Fu, Bing ;
Chen, Lin ;
Zhou, Yuntao ;
Zheng, Dong ;
Wei, Zhiqi ;
Dai, Jun ;
Pan, Haihong .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2018, 106 :26-37
[9]  
Goswami I, 2010, LECT NOTES COMPUT SC, V6457, P379, DOI 10.1007/978-3-642-17298-4_40
[10]   A fast path planning by path graph optimization [J].
Hwang, JY ;
Kim, JS ;
Lim, SS ;
Park, KH .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2003, 33 (01) :121-128