Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
[41]   On Anti-jamming Technique with Waveform Diverse Array Radar [J].
Xu J.-W. ;
Liao G.-S. ;
Zhang Y.-H. ;
So H.-C. .
Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2019, 47 (03) :545-551
[42]   Anti-jamming and LPI radar with spread spectrum technology [J].
Fu, Lianqing ;
Yang, Lisheng ;
Ma, Yaning ;
Wang, Tao .
ADVANCED RESEARCH ON INFORMATION SCIENCE, AUTOMATION AND MATERIAL SYSTEM, PTS 1-6, 2011, 219-220 :57-60
[43]   A Research on the Radar Anti-jamming Evaluation Index System [J].
Wang Feng ;
Liu Dongsheng ;
Liu Pengyuan ;
Li Bing .
PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON APPLIED SCIENCE AND ENGINEERING INNOVATION, 2015, 12 :239-242
[44]   A Review of Multi-Agent Reinforcement Learning Algorithms [J].
Liang, Jiaxin ;
Miao, Haotian ;
Li, Kai ;
Tan, Jianheng ;
Wang, Xi ;
Luo, Rui ;
Jiang, Yueqiu .
ELECTRONICS, 2025, 14 (04)
[45]   Lenient Multi-Agent Deep Reinforcement Learning [J].
Palmer, Gregory ;
Tuyls, Karl ;
Bloembergen, Daan ;
Savani, Rahul .
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON AUTONOMOUS AGENTS AND MULTIAGENT SYSTEMS (AAMAS' 18), 2018, :443-451
[46]   Multi-agent deep reinforcement learning: a survey [J].
Gronauer, Sven ;
Diepold, Klaus .
ARTIFICIAL INTELLIGENCE REVIEW, 2022, 55 (02) :895-943
[47]   Mean Field Multi-Agent Reinforcement Learning [J].
Yang, Yaodong ;
Luo, Rui ;
Li, Minne ;
Zhou, Ming ;
Zhang, Weinan ;
Wang, Jun .
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
[48]   WRFMR: A Multi-Agent Reinforcement Learning Method for Cooperative Tasks [J].
Liu, Hui ;
Zhang, Zhen ;
Wang, Dongqing .
IEEE ACCESS, 2020, 8 :216320-216331
[49]   Intelligent Reflecting Surface Assisted Anti-Jamming Communications: A Fast Reinforcement Learning Approach [J].
Yang, Helin ;
Xiong, Zehui ;
Zhao, Jun ;
Niyato, Dusit ;
Wu, Qingqing ;
Poor, H. Vincent ;
Tornatore, Massimo .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (03) :1963-1974
[50]   Reinforcement Learning Based QoS-Aware Anti-jamming Underwater Video Transmission [J].
Sun, Shiyu ;
Chen, Shun ;
Li, Shaoxuan ;
Lv, Zefang ;
Xiao, Liang ;
Su, Wei .
2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,