An Intelligent Bait Delivery Control Method for Flight Vehicle Evasion Based on Reinforcement Learning

被引:1
|
作者
Xue, Shuai [1 ]
Wang, Zhaolei [2 ]
Bai, Hongyang [1 ]
Yu, Chunmei [2 ]
Deng, Tianyu [1 ]
Sun, Ruisheng [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Energy & Power Engn, Nanjing 210094, Peoples R China
[2] Beijing Aerosp Automatic Control Inst, Natl Key Lab Sci & Technol Aerosp Intelligence Con, Beijing 100854, Peoples R China
基金
中国国家自然科学基金;
关键词
infrared bait; deep deterministic policy gradient; infrared interference; dropping strategy; online decision;
D O I
10.3390/aerospace11080653
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
During aerial combat, when an aircraft is facing an infrared air-to-air missile strike, infrared baiting technology is an important means of penetration, and the strategy of effective delivery of infrared bait is critical. To address this issue, this study proposes an improved deep deterministic policy gradient (DDPG) algorithm-based intelligent bait-dropping control method. Firstly, by modeling the relative motion between aircraft, bait, and incoming missiles, the Markov decision process of aircraft-bait-missile infrared effect was constructed with visual distance and line of sight angle as states. Then, the DDPG algorithm was improved by means of pre-training and classification sampling. Significantly, the infrared bait-dropping decision network was trained through interaction with the environment and iterative learning, which led to the development of the bait-dropping strategy. Finally, the corresponding environment was transferred to the Nvidia Jetson TX2 embedded platform for comparative testing. The simulation results showed that the convergence speed of this method was 46.3% faster than the traditional DDPG algorithm. More importantly, it was able to generate an effective bait-throwing strategy, enabling the aircraft to successfully evade the attack of the incoming missile. The strategy instruction generation time is only about 2.5 ms, giving it the ability to make online decisions.
引用
收藏
页数:18
相关论文
共 50 条
  • [1] A Learning-based Intelligent Control Method for Hypersonic Flight Vehicle
    Wang G.
    Xia H.
    Yuhang Xuebao/Journal of Astronautics, 2023, 44 (02): : 233 - 242
  • [2] Trajectory Tracking Control of Intelligent Vehicle Based on DDPG Method of Reinforcement Learning
    He, Yi-Lin
    Song, Ruo-Yang
    Ma, Jian
    Zhongguo Gonglu Xuebao/China Journal of Highway and Transport, 2021, 34 (11): : 335 - 348
  • [3] Research on Intelligent Control Method of Launch Vehicle Landing Based on Deep Reinforcement Learning
    Xue, Shuai
    Bai, Hongyang
    Zhao, Daxiang
    Zhou, Junyan
    MATHEMATICS, 2023, 11 (20)
  • [4] An Intelligent Control Method for Servo Motor Based on Reinforcement Learning
    Gao, Depeng
    Wang, Shuai
    Yang, Yuwei
    Zhang, Haifei
    Chen, Hao
    Mei, Xiangxiang
    Chen, Shuxi
    Qiu, Jianlin
    ALGORITHMS, 2024, 17 (01)
  • [5] UAV visual flight control method based on deep reinforcement learning
    Bai, Shuangxia
    Li, Bo
    Gan, Zhigang
    Chen, Daqing
    2021 INTERNATIONAL CONFERENCE ON CYBER-PHYSICAL SOCIAL INTELLIGENCE (ICCSI), 2021,
  • [6] Online Safe Flight Control Method Based on Constraint Reinforcement Learning
    Zhao, Jiawei
    Xu, Haotian
    Wang, Zhaolei
    Zhang, Tao
    DRONES, 2024, 8 (09)
  • [7] Method for numerical virtual flight with intelligent control based on machine learning
    Liang Y.
    Li G.
    Xu M.
    Hangkong Xuebao/Acta Aeronautica et Astronautica Sinica, 2023, 44 (17):
  • [8] Research on Robot Intelligent Control Method Based on Deep Reinforcement Learning
    Rao, Shu
    2022 6TH INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND INTELLIGENT CONTROL, ISCSIC, 2022, : 221 - 225
  • [9] Overcoming Challenges of Applying Reinforcement Learning for Intelligent Vehicle Control
    Pina, Rafael
    Tibebu, Haileleol
    Hook, Joosep
    De Silva, Varuna
    Kondoz, Ahmet
    SENSORS, 2021, 21 (23)
  • [10] Intelligent control of electric vehicle air conditioning system based on deep reinforcement learning
    He, Liange
    Li, Pengpai
    Zhang, Yan
    Jing, Haodong
    Gu, Zihan
    APPLIED THERMAL ENGINEERING, 2024, 245