The Research Of Aircraft Pursuit-Evasion Game Based on Improved DQN

被引:0
|
作者
Cui, Yameng [1 ]
Zheng, Chunsheng [2 ]
Liu, Jiarun [1 ]
Wang, Huixia [1 ]
Hu, Ruiguang [1 ]
Wang, Zhaolei [1 ]
机构
[1] Beijing Aerosp Automat Control Inst, Natl Key Lab Sci & Technol Aerosp Intelligent Con, Beijing, Peoples R China
[2] Beijing Aerosp Automat Control Inst, Beijing, Peoples R China
关键词
Pursuit-evasion game; aircraft; behavioral model; improved DQN;
D O I
10.1109/icus50048.2020.9274907
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The intelligent combat of aircraft has become an important research area. This paper studies the 1Vs1 pursuit-evasion game confrontation scenario of the aircraft, aiming to enable the red agent to find the optimal strategy to avoid the blue interception. First, the aircraft is abstracted into an agent, the kinematics model of the aircraft is simplified, and the behavior model of the aircraft with the bait throwing behavior is established. Based on the improved DQN algorithm, with relative distance, line-of-sight angle and azimuth as the state; the reward function design comprehensively considers the time, number of bait throwing, maneuvering time, and miss distance, and proposes an aircraft pursuit-evasion game algorithm (RB-DQN) in a three-dimensional environment. Experimental results show that the algorithm can effectively control the aircraft to complete the escape mission, and has satisfactory generalization.
引用
收藏
页码:857 / 862
页数:6
相关论文
共 50 条
  • [1] Visual aircraft identification as a pursuit-evasion game
    Raivio, T
    Ehtamo, H
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2000, 23 (04) : 701 - 708
  • [2] Uncertain pursuit-evasion game
    Feng, Yanghe
    Dai, Lanruo
    Gao, Jinwu
    Cheng, Guangquan
    SOFT COMPUTING, 2020, 24 (04) : 2425 - 2429
  • [3] Uncertain pursuit-evasion game
    Yanghe Feng
    Lanruo Dai
    Jinwu Gao
    Guangquan Cheng
    Soft Computing, 2020, 24 : 2425 - 2429
  • [4] Analysis of a New Pursuit-Evasion Game Based on Game Theory
    Chen, Hao
    Chen, Jing
    Zhang, Wanpeng
    Liu, Hongfu
    2015 11TH INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION (ICNC), 2015, : 875 - 880
  • [5] Surveillance for Security as a Pursuit-Evasion Game
    Bhattacharya, Sourabh
    Basar, Tamer
    Falcone, Maurizio
    DECISION AND GAME THEORY FOR SECURITY, GAMESEC 2014, 2014, 8840 : 370 - 379
  • [6] Numerical Approximation for A Visibility Based Pursuit-Evasion Game
    Bhattacharya, Sourabh
    Basar, Tamer
    Falcone, Maurizio
    2014 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2014), 2014, : 68 - 75
  • [7] A PURSUIT-EVASION GAME IN THE ORBITAL PLANE
    Selvakumar, Jhanani
    Bakolas, Efstathios
    SPACEFLIGHT MECHANICS 2017, PTS I - IV, 2017, 160 : 1105 - 1116
  • [8] Capture zones in a pursuit-evasion game
    Shima, T
    42ND IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-6, PROCEEDINGS, 2003, : 5450 - 5455
  • [9] Pursuit-Evasion Game for Normal Distributions
    Jun, Chanyoung
    Bhattacharya, Subhrajit
    Ghrist, Robert
    2014 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2014), 2014, : 83 - 88
  • [10] Surveillance for security as a pursuit-evasion game
    Bhattacharya, Sourabh, 1600, Springer Verlag (8840):