The Research Of Aircraft Pursuit-Evasion Game Based on Improved DQN

被引:0
|
作者
Cui, Yameng [1 ]
Zheng, Chunsheng [2 ]
Liu, Jiarun [1 ]
Wang, Huixia [1 ]
Hu, Ruiguang [1 ]
Wang, Zhaolei [1 ]
机构
[1] Beijing Aerosp Automat Control Inst, Natl Key Lab Sci & Technol Aerosp Intelligent Con, Beijing, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Beijing, Peoples R China
关键词
Pursuit-evasion game; aircraft; behavioral model; improved DQN;
D O I
10.1109/icus50048.2020.9274907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intelligent combat of aircraft has become an important research area. This paper studies the 1Vs1 pursuit-evasion game confrontation scenario of the aircraft, aiming to enable the red agent to find the optimal strategy to avoid the blue interception. First, the aircraft is abstracted into an agent, the kinematics model of the aircraft is simplified, and the behavior model of the aircraft with the bait throwing behavior is established. Based on the improved DQN algorithm, with relative distance, line-of-sight angle and azimuth as the state; the reward function design comprehensively considers the time, number of bait throwing, maneuvering time, and miss distance, and proposes an aircraft pursuit-evasion game algorithm (RB-DQN) in a three-dimensional environment. Experimental results show that the algorithm can effectively control the aircraft to complete the escape mission, and has satisfactory generalization.
引用
收藏
页码:857 / 862
页数:6
相关论文
共 50 条
  • [41] Revisiting a Three-Player Pursuit-Evasion Game
    János Szőts
    Andrey V. Savkin
    István Harmati
    Journal of Optimization Theory and Applications, 2021, 190 : 581 - 601
  • [42] Pursuit-Evasion Differential Game with Many Inertial Players
    Ibragimov, Gafurjan I.
    Salimi, Mehdi
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2009, 2009
  • [43] Relaxation of the pursuit-evasion differential game and iterative methods
    Chentsov, Alexander Georgievich
    Khachai, Daniil Mikhailovich
    TRUDY INSTITUTA MATEMATIKI I MEKHANIKI URO RAN, 2018, 24 (04): : 246 - 269
  • [44] Determination of The Barrier in The Qualitatively Pursuit-evasion Differential Game
    Yu, Fei
    Zhang, Xin
    Li, Qing
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [45] Co-evolutionary pursuit-evasion game on a plane
    Chen, Ying-Chun
    Qi, Huan
    Kongzhi yu Juece/Control and Decision, 2009, 24 (03): : 383 - 387
  • [46] Revisiting a Three-Player Pursuit-Evasion Game
    Szots, Janos
    Savkin, Andrey V.
    Harmati, Istvan
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2021, 190 (02) : 581 - 601
  • [47] Modeling and Solving of the Missile Pursuit-Evasion Game Problem
    Qi, Dingding
    Li, Longyue
    Xu, Hailong
    Tian, Ye
    Zhao, Huizhen
    2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, : 1526 - 1531
  • [48] Game-Theoretic Analysis of a Visibility Based Pursuit-Evasion Game in the Presence of Obstacles
    Bhattacharya, Sourabh
    Hutchinson, Seth
    Basar, Tamer
    2009 AMERICAN CONTROL CONFERENCE, VOLS 1-9, 2009, : 373 - 378
  • [49] Survey on dynamics and control problem research in spacecraft orbital pursuit-evasion game
    Zhu Y.
    Zhang C.
    Yang F.
    Yang L.
    Guofang Keji Daxue Xuebao/Journal of National University of Defense Technology, 2024, 46 (03): : 1 - 11
  • [50] Relaxation of the Pursuit-Evasion Differential Game and Iterative Methods
    Chentsov, A. G.
    Khachay, D. M.
    PROCEEDINGS OF THE STEKLOV INSTITUTE OF MATHEMATICS, 2020, 308 (SUPPL 1) : S35 - S57