Deep Reinforcement Learning-Based Anti-Jamming Algorithm Using Dual Action Network

被引:7
|
作者
Li, Xiangchen [1 ]
Chen, Jienan [1 ]
Ling, Xiang [1 ]
Wu, Tingyong [1 ]
机构
[1] Univ Elect Sci & Technol China, Natl Key Lab Sci & Technol Commun, Chengdu 611731, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Jamming; Wireless communication; Games; Receivers; Electromagnetics; Testing; Switches; Anti-jamming; Markov decision process; Index Terms; deep reinforcement learning; dual action network; action feedback mechanism; power efficiency; frequency switching overhead; field testing; STACKELBERG GAME; SYSTEMS;
D O I
10.1109/TWC.2022.3227575
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Due to the open nature of wireless communication, malicious electromagnetic jamming has long been a severe threat to the establishment and stability of communication links. To address this anti-jamming problem, a Markov decision process (MDP) with a two-dimensional action space consisting of transmit frequency and power is proposed in this paper, modeling the interaction between a normal communication link and the presence of malicious jammers in a frequency hopping (FH) communication system. Furthermore, we also prove the existence of the deterministic optimal policy of the proposed model theoretically. To obtain a policy for the communication link to avoid being jammed, the Dual Action Network-Based Deep Reinforcement Learning Algorithm, and Action Feedback Mechanism are proposed. The energy consumption and frequency switching overhead are considered and evaluated in both the proposed model and the algorithm. Finally, the proposed model and algorithm are verified not only in a virtual simulation environment but also in the field testing environment. The result suggests that the proposed algorithm is of great practical value for solving anti-jamming problems.
引用
收藏
页码:4625 / 4637
页数:13
相关论文
共 50 条
  • [21] UAV Anti-Jamming Video Transmissions With QoE Guarantee: A Reinforcement Learning-Based Approach
    Xiao, Liang
    Ding, Yuzhen
    Huang, Jinhao
    Liu, Sicong
    Tang, Yuliang
    Dai, Huaiyu
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (09) : 5933 - 5947
  • [22] Deep Reinforcement Learning Based Hopping Strategy for Wideband Anti-Jamming Wireless Communications
    Qi, Jie
    Zhang, Hongming
    Qi, Xiaolei
    Peng, Mugen
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (03) : 3568 - 3579
  • [23] Anti-jamming mobile control using QoS-based reinforcement learning
    Kuze, Naomi
    Nakashima, Taishi
    Ushio, Toshimitsu
    IEICE COMMUNICATIONS EXPRESS, 2019, 8 (12): : 501 - 506
  • [24] Anti-Jamming Strategy Based on Reinforcement Learning with Sequence Information
    Shin, Yoan (yashin@ssu.ac.kr), 1600, Institute of Electrical and Electronics Engineers Inc.
  • [25] A Novel Intelligent Anti-Jamming Algorithm Based on Deep Reinforcement Learning Assisted by Meta-Learning for Wireless Communication Systems
    Chen, Qingchuan
    Niu, Yingtao
    Wan, Boyu
    Xiang, Peng
    APPLIED SCIENCES-BASEL, 2023, 13 (23):
  • [26] Deep Reinforcement Learning Based Anti-Jamming Using Clear Channel Assessment Information in a Cognitive Radio Environment
    Ali, Abubakar S.
    Lunardi, Willian T.
    Bariah, Lina
    Baddeley, Michael
    Lopez, Martin Andreoni
    Giacalone, Jean-Pierre
    Muhaidat, Sami
    Proceedings - 2022 5th International Conference on Advanced Communication Technologies and Networking, CommNet 2022, 2022,
  • [27] Machine learning-based anti-jamming technique at the physical layer
    Chehimi, Mahdi
    Awad, Mohamad Khattar
    Al-Husseini, Mohammed
    Chehab, Ali
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (09):
  • [28] Reinforcement Learning-Based Dynamic Anti-Jamming Power Control in UAV Networks: An Effective Jamming Signal Strength Based Approach
    Ma, Nan
    Xu, Kui
    Xia, Xiaochen
    Wei, Chen
    Su, Qiao
    Shen, Maiying
    Xie, Wei
    IEEE COMMUNICATIONS LETTERS, 2022, 26 (10) : 2355 - 2359
  • [29] Spatial Anti-Jamming Scheme for Internet of Satellites Based on the Deep Reinforcement Learning and Stackelberg Game
    Han, Chen
    Huo, Liangyu
    Tong, Xinhai
    Wang, Haichao
    Liu, Xian
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (05) : 5331 - 5342
  • [30] An intelligent decision-making method for anti-jamming communication based on deep reinforcement learning
    Song B.
    Xu H.
    Jiang L.
    Rao N.
    Xibei Gongye Daxue Xuebao/Journal of Northwestern Polytechnical University, 2021, 39 (03): : 641 - 649