The Research Of Aircraft Pursuit-Evasion Game Based on Improved DQN

被引:0
|
作者
Cui, Yameng [1 ]
Zheng, Chunsheng [2 ]
Liu, Jiarun [1 ]
Wang, Huixia [1 ]
Hu, Ruiguang [1 ]
Wang, Zhaolei [1 ]
机构
[1] Beijing Aerosp Automat Control Inst, Natl Key Lab Sci & Technol Aerosp Intelligent Con, Beijing, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Beijing, Peoples R China
关键词
Pursuit-evasion game; aircraft; behavioral model; improved DQN;
D O I
10.1109/icus50048.2020.9274907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intelligent combat of aircraft has become an important research area. This paper studies the 1Vs1 pursuit-evasion game confrontation scenario of the aircraft, aiming to enable the red agent to find the optimal strategy to avoid the blue interception. First, the aircraft is abstracted into an agent, the kinematics model of the aircraft is simplified, and the behavior model of the aircraft with the bait throwing behavior is established. Based on the improved DQN algorithm, with relative distance, line-of-sight angle and azimuth as the state; the reward function design comprehensively considers the time, number of bait throwing, maneuvering time, and miss distance, and proposes an aircraft pursuit-evasion game algorithm (RB-DQN) in a three-dimensional environment. Experimental results show that the algorithm can effectively control the aircraft to complete the escape mission, and has satisfactory generalization.
引用
收藏
页码:857 / 862
页数:6
相关论文
共 50 条
  • [21] A PURSUIT-EVASION GAME OF LINEAR SYSTEMS WITH DELAY
    CHYUNG, DH
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1970, AC15 (03) : 387 - &
  • [22] A simplified pursuit-evasion game with reinforcement learning
    Paczolay G.
    Harmati I.
    Periodica polytechnica Electrical engineering and computer science, 2021, 65 (02): : 160 - 166
  • [23] Policy Improvements for Probabilistic Pursuit-Evasion Game
    Kwak, Dong Jun
    Kim, H. Jin
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2014, 74 (3-4) : 709 - 724
  • [24] CONTROL SEQUENCING IN A GAME OF IDENTITY PURSUIT-EVASION
    Wenk, Carl J.
    SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2015, 53 (04) : 1815 - 1841
  • [25] ONLINE SOLUTION OF A STOCHASTIC PURSUIT-EVASION GAME
    LEONDES, CT
    MONS, B
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 1979, 28 (03) : 411 - 428
  • [26] A Pursuit-evasion Game with Hybrid Pursuer Dynamics
    Shinar, Josef
    Glizer, Valery Y.
    Turetsky, Vladimir
    EUROPEAN JOURNAL OF CONTROL, 2009, 15 (06) : 665 - 684
  • [27] Policy Improvements for Probabilistic Pursuit-Evasion Game
    Dong Jun Kwak
    H. Jin Kim
    Journal of Intelligent & Robotic Systems, 2014, 74 : 709 - 724
  • [28] A pursuit-evasion game with one curvature constraint
    Chu, HJ
    Hsieh, JG
    Lee, YS
    Hsia, KH
    OPTIMAL CONTROL APPLICATIONS & METHODS, 2000, 21 (02): : 47 - 61
  • [29] A pursuit-evasion game with hybrid system of dynamics
    Salimi, Mehdi
    MATHEMATICAL METHODS IN THE APPLIED SCIENCES, 2020,
  • [30] A pursuit-evasion game robot controller design based on a neural network with an improved optimization algorithm
    Hasan, Mustafa Wassef
    Ibrahim, Luay G.
    RESULTS IN CONTROL AND OPTIMIZATION, 2024, 17