Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning

被引:0
|
作者
Peng, Wenshen [1 ]
He, Chuan [1 ]
Cao, Fei [1 ]
Hu, Changhua [1 ]
Jiao, Licheng [2 ]
机构
[1] Rocket Force Univ Engn, Xian 710025, Peoples R China
[2] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Radar; Games; Decision making; Electronic countermeasures; Convergence; Spaceborne radar; Radar countermeasures; Indexes; Signal processing algorithms; Multi-agent deep reinforcement learning (MADRL); neural fictitious self-play (NFSP); radar anti-jamming; extensive-form game (EFG); decision making; GAME-THEORY;
D O I
10.1109/LSP.2024.3493797
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As jamming systems continue to evolve, jammers are becoming increasingly complex. They modify their strategies in response to changes in radar status, thereby creating a dynamic confrontation with the radar. Currently, deep reinforcement learning (DRL) methods are widely employed in the decision-making process for radar anti-jamming strategies; however, most of these methods overlook the learning capabilities of the jammer. This letter proposes a novel multi-agent deep reinforcement learning (MADRL) method that leverages the robust capabilities of the neural fictitious self-play (NFSP) method and extensive-form game (EFG) frameworks to address multi-agent interactions and partial information observability challenges. The letter primarily discusses the model design, which includes the construction of the EFG framework, hierarchical optimization of the action space, and the design of the reward function. Comparative results with other state-of-the-art methods demonstrate that this approach achieves significant accuracy and rapid convergence in anti-jamming decision-making, thereby effectively enhancing the intelligent anti-jamming capabilities of radar systems.
引用
收藏
页码:3114 / 3118
页数:5
相关论文
共 50 条
  • [1] GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network
    Chen, Miaojiang
    Liu, Wei
    Zhang, Ning
    Li, Junling
    Ren, Yingying
    Yi, Meng
    Liu, Anfeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [2] Multi-agent Learning based Anti-jamming Communications Against Cognitive Jammers
    Jayaweera, Milidu N.
    2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 122 - 126
  • [3] An Intelligent Strategy Decision Method for Collaborative Jamming Based on Hierarchical Multi-Agent Reinforcement Learning
    Zhang, Wenxu
    Zhao, Tong
    Zhao, Zhongkai
    Wang, Yajie
    Liu, Feiran
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2024, 10 (04) : 1467 - 1480
  • [4] Intelligent Dynamic Spectrum Anti-Jamming Communications: A Deep Reinforcement Learning Perspective
    Li, Wen
    Chen, Jin
    Liu, Xin
    Wang, Ximing
    Li, Yangyang
    Liu, Dianxiong
    Xu, Yuhua
    IEEE WIRELESS COMMUNICATIONS, 2022, 29 (05) : 60 - 67
  • [5] Anti-jamming radar waveform design for repeater jammer using reinforcement learning
    Aziz, Muhammmad Majid
    Habib, Aamir
    Maud, Abdur Rahman M.
    Zafar, Adnan
    Irtaza, Syed Ali
    VEHICULAR COMMUNICATIONS, 2024, 47
  • [6] Design of Anti-Jamming Waveforms for Cognitive Radar Based on Deep Reinforcement Learning
    Sun, Taohan
    Ma, Xiaomeng
    Zhao, Yangguang
    Xue, Fengtao
    Gao, Meiguo
    2024 6th International Conference on Electronic Engineering and Informatics, EEI 2024, 2024, : 1596 - 1605
  • [7] Adaptation of Frequency Hopping Interval for Radar Anti-Jamming Based on Reinforcement Learning
    Ailiya, Wei
    Yi, Wei K.
    Varshney, Pramod K.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (12) : 12434 - 12449
  • [8] Airborne Radar Anti-Jamming Waveform Design Based on Deep Reinforcement Learning
    Zheng, Zexin
    Li, Wei
    Zou, Kun
    SENSORS, 2022, 22 (22)
  • [9] Reinforcement Learning-Based Anti-Jamming in Networked UAV Radar Systems
    Wu, Qinhao
    Wang, Hongqiang
    Li, Xiang
    Zhang, Bo
    Peng, Jinlin
    APPLIED SCIENCES-BASEL, 2019, 9 (23):
  • [10] Game Theory and Multi-Agent DRL Based Anti-Jamming Transmission for Integrated Air-Ground Network
    Liao, Chengjian
    Xu, Kui
    Hu, Guojie
    Xia, Xiaochen
    Wei, Chen
    Xie, Wei
    Li, Chunguo
    Wang, Yurong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (12) : 19565 - 19581