Classical versus reinforcement learning algorithms for unmanned aerial vehicle network communication and coverage path planning: A systematic literature review

被引:6
作者
Mannan, Abdul [1 ,2 ]
Obaidat, Mohammad S. [3 ,4 ,5 ]
Mahmood, Khalid [6 ,8 ]
Ahmad, Aftab [7 ]
Ahmad, Rodina [1 ,9 ]
机构
[1] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur, Malaysia
[2] Bahauddin Zakariya Univ, Dept Comp Sci, Multan, Pakistan
[3] Univ Texas Permian Basin, Comp Sci Dept, Odessa, TX USA
[4] Univ Texas Permian Basin, Cybersecur Ctr, Odessa, TX USA
[5] Univ Jordan, King Abdullah II Sch Informat Technol, Amman, Jordan
[6] Natl Yunlin Univ Sci & Technol, Grad Sch Intelligent Data Sci, Yunlin, Taiwan
[7] Natl Yunlin Univ Sci & Technol, Dept Elect, Yunlin, Taiwan
[8] Natl Yunlin Univ Sci & Technol, Grad Sch Intelligent Data Sci, Yunlin 64002, Taiwan
[9] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur 50603, Malaysia
关键词
air; 2; ground; coverage path planning; network communication; reinforcement learning; unmanned aerial vehicles; SEARCH ALGORITHM; RRT-ASTERISK; AVOIDANCE; MODEL;
D O I
10.1002/dac.5423
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The unmanned aerial vehicle network communication includes all points of interest during the coverage path planning. Coverage path planning in such networks is crucial for many applications, such as surveying, monitoring, and disaster management. Since the coverage path planning belongs to NP-hard issues, researchers in this domain are constantly looking for optimal solutions for this task. The speed, direction, altitude, environmental variations, and obstacles make coverage path planning more difficult. Researchers have proposed numerous algorithms regarding coverage path planning. In this study, we examined and discussed existing state-of-the-art coverage path planning algorithms. We divided the existing techniques into two core categories: Classical and reinforcement learning. The classical algorithms are further divided into subcategories due to the availability of considerable variations in this category. For each algorithm in both types, we examined the issues of mobility, altitude, and characteristics of known and unknown environments. We also discuss the optimality of different algorithms. At the end of each section, we discuss the existing research gaps and provide future insights to overcome those gaps.
引用
收藏
页数:31
相关论文
共 154 条
[1]   Path planning for robotic demining: Robust sensor-based coverage of unstructured environments and probabilistic methods [J].
Acar, EU ;
Choset, H ;
Zhang, YG ;
Schervish, M .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2003, 22 (7-8) :441-466
[2]   Path planning techniques for unmanned aerial vehicles: A review, solutions, and challenges [J].
Aggarwal, Shubhani ;
Kumar, Neeraj .
COMPUTER COMMUNICATIONS, 2020, 149 :270-299
[3]   Cooperative Path Planning of Multiple UAVs by using Max-Min Ant Colony Optimization along with Cauchy Mutant Operator [J].
Ali, Zain Anwar ;
Han Zhangang ;
Hang, Wang Bo .
FLUCTUATION AND NOISE LETTERS, 2021, 20 (01)
[4]  
Amin J.N., 2006, AIAA GUIDANCE NAVIGA
[5]   Reinforcement Learning-Based Complete Area Coverage Path Planning for a Modified hTrihex Robot [J].
Apuroop, Koppaka Ganesh Sai ;
Le, Anh Vu ;
Elara, Mohan Rajesh ;
Sheu, Bing J. .
SENSORS, 2021, 21 (04) :1-20
[6]   A survey of robot learning from demonstration [J].
Argall, Brenna D. ;
Chernova, Sonia ;
Veloso, Manuela ;
Browning, Brett .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2009, 57 (05) :469-483
[7]  
Atkar PN, 2001, IEEE INT CONF ROBOT, P699, DOI 10.1109/ROBOT.2001.932632
[8]   AN OVERVIEW OF PATH PLANNING TECHNOLOGIES FOR UNMANNED AERIAL VEHICLES [J].
Bal, Mert .
THERMAL SCIENCE, 2022, 26 (04) :2865-2876
[9]  
Battocletti Gianpietro, 2021, AIAA AVIATION 2021 FORUM, DOI 10.2514/6.2021-3016
[10]   UAV Path Planning for Wireless Data Harvesting: A Deep Reinforcement Learning Approach [J].
Bayerlein, Harald ;
Theile, Mirco ;
Caccamo, Marco ;
Gesbert, David .
2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,