Reinforcement learning-based multi-strategy cuckoo search algorithm for 3D UAV path planning

被引:62
作者
Yu, Xiaobing [1 ]
Luo, Wenguan
机构
[1] Nanjing Univ Informat Sci & Technol, Res Ctr Risk Management & Emergency Decis Making, Sch Management Sci & Engn, Nanjing 210044, Peoples R China
基金
中国国家自然科学基金;
关键词
Path planning; Constrained optimization problem; Reinforcement learning; Cuckoo search algorithm; DIFFERENTIAL EVOLUTION; BAT ALGORITHM;
D O I
10.1016/j.eswa.2023.119910
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unmanned aerial vehicles are applied extensively in various fields due to their advantages of low-cost, high -maneuverability, and easy-operation. However, the path planning problem of unmanned aerial vehicles, which directly determines the flight safety and efficiency, still remains challenging when building and optimizing the path model. To further study the path planning problem, we firstly construct it as a constrained optimization problem. The objective function considers the costs of path length and threat, and the constraints involve the collision and turning angle. Additionally, we employ the theory of B-Spline curve to represent the planned paths to facilitate the optimization of established model. Then, aiming at the poor searchability and slow convergence speed of current optimization methods, we propose a reinforcement learning-based multi-strategy cuckoo search algorithm. Specifically, we establish an innovative reinforcement learning-based multi-strategy mechanism and a reinforced switch parameter based on the theory of reinforcement learning. To verify the effectiveness of the proposed algorithm, extensive experiments are carried out on the CEC'17 benchmark test and different three-dimensional path planning problems. Detailed statistical analysis of the experimental results confirm the supe-riority of our proposed algorithm to the other well-established algorithms.
引用
收藏
页数:20
相关论文
共 64 条
[1]   Discrete hybrid cuckoo search and simulated annealing algorithm for solving the job shop scheduling problem [J].
Alkhateeb, Faisal ;
Abed-alguni, Bilal H. ;
Al-rousan, Mohammad Hani .
JOURNAL OF SUPERCOMPUTING, 2022, 78 (04) :4799-4826
[2]   Performance of a Novel Chaotic Firefly Algorithm with Enhanced Exploration for Tackling Global Optimization Problems: Application for Dropout Regularization [J].
Bacanin, Nebojsa ;
Stoean, Ruxandra ;
Zivkovic, Miodrag ;
Petrovic, Aleksandar ;
Rashid, Tarik A. ;
Bezdan, Timea .
MATHEMATICS, 2021, 9 (21)
[3]   Limited-Damage A*: A path search algorithm that considers damage as a feasibility criterion [J].
Bayili, Serhat ;
Polat, Faruk .
KNOWLEDGE-BASED SYSTEMS, 2011, 24 (04) :501-512
[4]   A Self-Adaptive Cuckoo Search Algorithm Using a Machine Learning Technique [J].
Caselli, Nicolas ;
Soto, Ricardo ;
Crawford, Broderick ;
Valdivia, Sergio ;
Olivares, Rodrigo .
MATHEMATICS, 2021, 9 (16)
[5]   Reinforcement Learning-Based Differential Evolution With Cooperative Coevolution for a Compensatory Neuro-Fuzzy Controller [J].
Chen, Cheng-Hung ;
Liu, Chong-Bin .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (10) :4719-4729
[6]  
Chen X, 2014, CHIN CONT DECIS CONF, P1069, DOI 10.1109/CCDC.2014.6852323
[7]   A flexible reference point-based multi-objective evolutionary algorithm: An application to the UAV route planning problem [J].
Dasdemir, Erdi ;
Koksalan, Murat ;
Ozturk, Diclehan Tezcaner .
COMPUTERS & OPERATIONS RESEARCH, 2020, 114
[8]   Review on the Technological Development and Application of UAV Systems [J].
Fan, Bangkui ;
Li, Yun ;
Zhang, Ruiyu ;
Fu, Qiqi .
CHINESE JOURNAL OF ELECTRONICS, 2020, 29 (02) :199-207
[9]  
Fister I., 2022, Differential Evolution: From Theory to Practice, P43
[10]   Route Planning for Unmanned Aerial Vehicle (UAV) on the Sea Using Hybrid Differential Evolution and Quantum-Behaved Particle Swarm Optimization [J].
Fu, Yangguang ;
Ding, Mingyue ;
Zhou, Chengping ;
Hu, Hanping .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2013, 43 (06) :1451-1465