Autonomous Defense of Unmanned Aerial Vehicles Against Missile Attacks Using a GRU-Based PPO Algorithm

被引:3
|
作者
Zhang, Cheng [1 ]
Tao, Chengyang [1 ]
Xu, Yuelei [1 ]
Feng, Weijia [1 ]
Rasol, Jarhinbek [1 ]
Hui, Tian [1 ]
Dong, Liheng [1 ]
机构
[1] Northwestern Polytech Univ, Unmanned Syst Res Inst, 127 West Youyi Rd, Xian 710072, Shaanxi, Peoples R China
关键词
Unmanned aerial vehicle; Deep reinforcement learning; Decision-making; Centroid jamming; EVASIVE MANEUVER STRATEGY; REINFORCEMENT; DECISION;
D O I
10.1007/s42405-024-00707-7
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
This paper introduces a method enabling unmanned aerial vehicles (UAVs) to autonomously defend themselves against incoming missiles during military missions. A simulation environment for UAV defense against incoming missiles was created by constructing motion models for a UAV, a missile, and infrared decoys in three-dimensional space. A UAV defense strategy generation algorithm based on gated recurrent unit (GRU) and proximal policy optimization (PPO) is proposed, which effectively addresses the problem of low survival rates when under attack from enemy missiles. Specifically, the algorithm estimates the current true state based on current and historical observations and makes decisions based on the state estimate, effectively solving the non-Markov problem caused by the lack of infrared decoy information in the observations. The experimental results indicate that this method provides an effective defense strategy, combining evasion maneuvers with infrared decoys to effectively evade incoming missiles.
引用
收藏
页码:1034 / 1049
页数:16
相关论文
共 47 条
  • [21] Unmanned Aerial Vehicles Sensor-Based Detection Systems Using Machine Learning Algorithms
    Al-Adwan, Romil S.
    Al-Habahbeh, Osama M.
    INTERNATIONAL JOURNAL OF MECHANICAL ENGINEERING AND ROBOTICS RESEARCH, 2022, 11 (09): : 662 - 668
  • [22] Vision-based Terrain Referenced Navigation for Unmanned Aerial Vehicles using Homography Relationship
    Dongjin Lee
    Yeongju Kim
    Hyochoong Bang
    Journal of Intelligent & Robotic Systems, 2013, 69 : 489 - 497
  • [23] A STUDY OF REAL-TIME RECOGNITION OF UNMANNED AERIAL VEHICLES IN OUTDOOR AREAS BASED ON A RANDOM FOREST ALGORITHM
    Tian, Zhoutai
    Yu, Daojie
    AVIATION, 2022, 26 (04) : 169 - 175
  • [24] Autonomous Landing of Quadrotor Unmanned Aerial Vehicles Based on Multi-Level Marker and Linear Active Disturbance Reject Control
    Lv, Mingming
    Fan, Bo
    Fang, Jiwen
    Wang, Jia
    SENSORS, 2024, 24 (05)
  • [25] Self-Organized Learning Algorithm for Immune Neuro-Fuzzy Anti-collision System of Autonomous Unmanned Aerial Vehicles' Team
    Beinarovica, A.
    Gorobetz, M.
    Levchenkov, A.
    TRANSPORT MEANS 2018, PTS I-III, 2018, : 1334 - 1341
  • [26] AKSED: adaptive knowledge-based system for event detection using collaborative unmanned aerial vehicles
    Wang, X. Sean
    Lee, Byung Suk
    Sadjadi, Firooz
    AUTOMATIC TARGET RECOGNITION XVI, 2006, 6234
  • [27] Case-Based Reasoning Approach Applied to Surveillance System Using an Autonomous Unmanned Aerial Vehicle
    Pinto, Milena F.
    Melo, Aurelio G.
    Marcato, Andre. L. M.
    Urdiales, Cristina
    2017 IEEE 26TH INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS (ISIE), 2017, : 1324 - 1329
  • [28] Multilayer Interval Type-2 Fuzzy Controller Design for Quadcopter Unmanned Aerial Vehicles Using Jaya Algorithm
    Le, Tien-Loc
    Quynh, Nguyen Vu
    Long, Ngo Kim
    Hong, Sung Kyung
    IEEE ACCESS, 2020, 8 : 181246 - 181257
  • [29] Real-time route planning of unmanned aerial vehicles based on improved soft actor-critic algorithm
    Zhou, Yuxiang
    Shu, Jiansheng
    Zheng, Xiaolong
    Hao, Hui
    Song, Huan
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [30] Non-contact structural displacement measurement using Unmanned Aerial Vehicles and video-based systems
    Ribeiro, D.
    Santos, R.
    Cabral, R.
    Saramago, G.
    Montenegro, P.
    Carvalho, H.
    Correia, J.
    Calcada, R.
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 160