Autonomous Defense of Unmanned Aerial Vehicles Against Missile Attacks Using a GRU-Based PPO Algorithm

被引:3
|
作者
Zhang, Cheng [1 ]
Tao, Chengyang [1 ]
Xu, Yuelei [1 ]
Feng, Weijia [1 ]
Rasol, Jarhinbek [1 ]
Hui, Tian [1 ]
Dong, Liheng [1 ]
机构
[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
关键词
Unmanned aerial vehicle; Deep reinforcement learning; Decision-making; Centroid jamming; EVASIVE MANEUVER STRATEGY; REINFORCEMENT; DECISION;
D O I
10.1007/s42405-024-00707-7
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper introduces a method enabling unmanned aerial vehicles (UAVs) to autonomously defend themselves against incoming missiles during military missions. A simulation environment for UAV defense against incoming missiles was created by constructing motion models for a UAV, a missile, and infrared decoys in three-dimensional space. A UAV defense strategy generation algorithm based on gated recurrent unit (GRU) and proximal policy optimization (PPO) is proposed, which effectively addresses the problem of low survival rates when under attack from enemy missiles. Specifically, the algorithm estimates the current true state based on current and historical observations and makes decisions based on the state estimate, effectively solving the non-Markov problem caused by the lack of infrared decoy information in the observations. The experimental results indicate that this method provides an effective defense strategy, combining evasion maneuvers with infrared decoys to effectively evade incoming missiles.
引用
收藏
页码:1034 / 1049
页数:16
相关论文
共 47 条
  • [41] DiscriminatingPennisetum alopecuoidesplants in a grazed pasture from unmanned aerial vehicles using object-based image analysis and random forest classifier
    Yuba, Norio
    Kawamura, Kensuke
    Yasuda, Taisuke
    Lim, Jihyun
    Yoshitoshi, Rena
    Watanabe, Nariyasu
    Kurokawa, Yuzo
    Maeda, Teruo
    GRASSLAND SCIENCE, 2021, 67 (01) : 73 - 82
  • [42] Tag-based visual-inertial localization of unmanned aerial vehicles in indoor construction environments using an on-manifold extended Kalman filter
    Kayhani, Navid
    Zhao, Wenda
    McCabe, Brenda
    Schoellig, Angela P.
    AUTOMATION IN CONSTRUCTION, 2022, 135
  • [43] Two-phase multi-expert knowledge approach by using fuzzy clustering and rule-based system for technology evaluation of unmanned aerial vehicles
    Colak, Murat
    Kaya, Ihsan
    Karasan, Ali
    Erdogan, Melike
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (07): : 5479 - 5495
  • [44] Two-phase multi-expert knowledge approach by using fuzzy clustering and rule-based system for technology evaluation of unmanned aerial vehicles
    Murat Çolak
    İhsan Kaya
    Ali Karaşan
    Melike Erdoğan
    Neural Computing and Applications, 2022, 34 : 5479 - 5495
  • [45] Estimation of bell pepper evapotranspiration using two-source energy balance model based on high-resolution thermal and visible imagery from unmanned aerial vehicles
    Tunca, Emre
    Koksal, Eyup Selim
    Torres-Rua, Alfonso
    Kustas, William P.
    Hector Nieto
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (02)
  • [46] Real-time autonomous indoor navigation and vision-based damage assessment of reinforced concrete structures using low-cost nano aerial vehicles
    Tavasoli, Sina
    Pan, Xiao
    Yang, T. Y.
    JOURNAL OF BUILDING ENGINEERING, 2023, 68
  • [47] CatBoost algorithm for estimating maize above-ground biomass using unmanned aerial vehicle-based multi-source sensor data and SPAD values
    Zhai, Weiguang
    Li, Changchun
    Fei, Shuaipeng
    Liu, Yanghua
    Ding, Fan
    Cheng, Qian
    Chen, Zhen
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 214