Autonomous Maneuver Decisions via Transfer Learning Pigeon-Inspired Optimization for UCAVs in Dogfight Engagements

被引:1
作者
Wanying Ruan [1 ]
Haibin Duan [2 ,3 ,4 ]
Yimin Deng [1 ]
机构
[1] the School of Automation Science and Electrical Engineering, Beihang University (BUAA)
[2] IEEE
[3] the State Key Laboratory of Virtual Reality Technology and Systems, the School of Automation Science and Electrical Engineering, Beihang University (BUAA)
[4] Peng Cheng Laboratory
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论]; E926.3 [各种军用飞机];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ; 0826 ; 082601 ;
摘要
This paper proposes an autonomous maneuver decision method using transfer learning pigeon-inspired optimization(TLPIO) for unmanned combat aerial vehicles(UCAVs) in dogfight engagements. Firstly, a nonlinear F-16 aircraft model and automatic control system are constructed by a MATLAB/Simulink platform. Secondly, a 3-degrees-of-freedom(3-DOF) aircraft model is used as a maneuvering command generator, and the expanded elemental maneuver library is designed, so that the aircraft state reachable set can be obtained.Then, the game matrix is composed with the air combat situation evaluation function calculated according to the angle and range threats. Finally, a key point is that the objective function to be optimized is designed using the game mixed strategy, and the optimal mixed strategy is obtained by TLPIO. Significantly, the proposed TLPIO does not initialize the population randomly, but adopts the transfer learning method based on Kullback-Leibler(KL) divergence to initialize the population, which improves the search accuracy of the optimization algorithm. Besides, the convergence and time complexity of TLPIO are discussed.Comparison analysis with other classical optimization algorithms highlights the advantage of TLPIO. In the simulation of air combat, three initial scenarios are set, namely, opposite, offensive and defensive conditions. The effectiveness performance of the proposed autonomous maneuver decision method is verified by simulation results.
引用
收藏
页码:1639 / 1657
页数:19
相关论文
共 17 条
[1]  
Robust Attitude Control for Reusable Launch Vehicles Based on Fractional Calculus and Pigeon-inspired Optimization[J]. Qiang Xue,Haibin Duan.IEEE/CAA Journal of Automatica Sinica. 2017(01)
[2]   Multi-agent hierarchical policy gradient for Air Combat Tactics emergence via self-play [J].
Sun, Zhixiao ;
Piao, Haiyin ;
Yang, Zhen ;
Zhao, Yiyang ;
Zhan, Guang ;
Zhou, Deyun ;
Meng, Guanglei ;
Chen, Hechang ;
Chen, Xing ;
Qu, Bohao ;
Lu, Yuanjie .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2021, 98
[3]   UAV Autonomous Aerial Combat Maneuver Strategy Generation with Observation Error Based on State-Adversarial Deep Deterministic Policy Gradient and Inverse Reinforcement Learning [J].
Kong, Weiren ;
Zhou, Deyun ;
Yang, Zhen ;
Zhao, Yiyang ;
Zhang, Kai .
ELECTRONICS, 2020, 9 (07) :1-24
[4]   Maneuver Decision of UAV in Short-Range Air Combat Based on Deep Reinforcement Learning [J].
Yang, Qiming ;
Zhang, Jiandong ;
Shi, Guoqing ;
Hu, Jinwen ;
Wu, Yong .
IEEE ACCESS, 2020, 8 :363-378
[5]   Limit-Cycle-Based Mutant Multiobjective Pigeon-Inspired Optimization [J].
Duan, Haibin ;
Huo, Mengzhen ;
Shi, Yuhui .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (05) :948-959
[6]   Predator-Prey Pigeon-Inspired Optimization for UAV ALS Longitudinal Parameters Tuning [J].
Duan, Haibin ;
Huo, Mengzhen ;
Yang, Zhiyuan ;
Shi, Yuhui ;
Luo, Qinan .
IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2019, 55 (05) :2347-2358
[7]   Effectiveness of Autonomous Decision Making for Unmanned Combat Aerial Vehicles in Dogfight Engagements [J].
Ramirez Lopez, Nelson ;
Zbikowski, Rafal .
JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2018, 41 (04) :1015-1021
[8]   Transfer Learning-Based Dynamic Multiobjective Optimization Algorithms [J].
Jiang, Min ;
Huang, Zhongqiang ;
Qiu, Liming ;
Huang, Wenzhen ;
Yen, Gary G. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2018, 22 (04) :501-514
[9]   Three-Dimensional Path Planning for Uninhabited Combat Aerial Vehicle Based on Predator-Prey Pigeon-Inspired Optimization in Dynamic Environment [J].
Zhang, Bo ;
Duan, Haibin .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2017, 14 (01) :97-107
[10]  
Genetic Fuzzy based Artificial Intelligence for Unmanned Combat Aerial Vehicle Control in Simulated Air Combat Missions[J] . Nicholas Ernest,David Carroll,Corey Schumacher,Matthew Clark,Kelly Cohen,Gene Lee.Journal of Defense Management . 2016 (1)