Reinforcement Learning based Anti-jamming Frequency Hopping Strategies Design for Cognitive Radar

被引:0
|
作者
Li Kang [1 ]
Jiu Bo [1 ]
Liu Hongwei [1 ]
Liang Siyuan [1 ]
机构
[1] Xidian Univ, Natl Lab Radar Signal Proc, Xian, Shaanxi, Peoples R China
来源
2018 IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, COMMUNICATIONS AND COMPUTING (ICSPCC) | 2018年
关键词
cognitive radar; frequency hopping; Q-learning; deep Q-network; jammer;
D O I
暂无
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Frequency agile (FA) radar is capable of altering carrier frequency randomly, which is especially useful fur radar anti-jamming designs. Obviously, random frequency hopping is not the best choice if the radar can learn the jammer' strategy. In this paper, a novel frequency hopping strategy design method is proposed for cognitive radar to defeat the smart jammer, in which the radar does not know the exact jamming model. Q-learning and deep Q-network (DQN) is utilized to solve this problem. By applying the reinforcement learning algorithm, the radar is able to learn the jammer's strategies through the interaction with environment and adopt the best action to obtain high reward. The learning performance of DQN is much better than that of Q-learning especially when the available frequencies are large. The proposed method can improve the signal-to interference-plus-noise ratio (SINR) for the radar when the jamming model is not available. Numerical results are given to illustrate the effectiveness of the proposed method.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Anti-Jamming Communications Using Spectrum Waterfall: A Deep Reinforcement Learning Approach
    Liu, Xin
    Xu, Yuhua
    Jia, Luliang
    Wu, Qihui
    Anpalagan, Alagan
    IEEE COMMUNICATIONS LETTERS, 2018, 22 (05) : 998 - 1001
  • [22] Lightweight Reinforcement Learning with State Abstraction for Dynamic Spectrum Anti-Jamming Communications
    Liu, Xin
    Wang, Ximing
    Xu, Yuhua
    Du, Zhiyong
    Xu, Yifan
    Han, Hao
    2024 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC 2024, 2024,
  • [23] Mode Hopping for Anti-Jamming in Radio Vortex Wireless Communications
    Liang, Liping
    Cheng, Wenchi
    Zhang, Wei
    Zhang, Hailin
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2018, 67 (08) : 7018 - 7032
  • [24] Research On Anti-Jamming Method Of Frequency Hopping Communication Based On Blind Source Separation In Complex Electromagnetic Environment
    Wang Rui
    Wei Wei
    2019 INTERNATIONAL CONFERENCE ON SMART GRID AND ELECTRICAL AUTOMATION (ICSGEA), 2019, : 378 - 381
  • [25] Anti-Jamming Message-Driven Frequency Hopping-Part II: Capacity Analysis Under Disguised Jamming
    Zhang, Lei
    Li, Tongtong
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2013, 12 (01) : 80 - 88
  • [26] A Novel Cognitive Anti-jamming Stochastic Game
    Aref, Mohamed A.
    Jayaweera, Sudharman K.
    2017 COGNITIVE COMMUNICATIONS FOR AEROSPACE APPLICATIONS WORKSHOP (CCAA), 2017,
  • [27] Multi-Domain Resource Scheduling for Surveillance Radar Anti-Jamming based on Q-Learning
    Yang, Tao
    Yuan, Ye
    Yi, Wei
    2023 IEEE RADAR CONFERENCE, RADARCONF23, 2023,
  • [28] Anti-Jamming Partially Regular LDPC Codes for Follower Jamming with Rayleigh Block Fading in Frequency Hopping Spread Spectrum
    Kim, Chanki
    No, Jong-Seon
    Park, Jinsoo
    Song, Hong-Yeop
    Ahn, Jaeha
    2016 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC 2016): TOWARDS SMARTER HYPER-CONNECTED WORLD, 2016, : 583 - 587
  • [29] Optimal frequency-hopping anti-jamming strategy based on multi-step prediction Markov decision process
    Wei, Peng
    Wang, Shilian
    Luo, Junshan
    Liu, Yan
    Hu, Li
    WIRELESS NETWORKS, 2021, 27 (07) : 4581 - 4601
  • [30] A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks
    Yao, Fuqiang
    Jia, Luliang
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2019, 8 (04) : 1024 - 1027