Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

被引:2
作者
Xu, Yuting [1 ]
Wang, Chao [1 ]
Liang, Jiakai [1 ]
Yue, Keqiang [1 ,2 ]
Li, Wenjun [1 ]
Zheng, Shilian [2 ]
Zhao, Zhijin [3 ]
机构
[1] Hangzhou Dianzi Univ, Key Lab RF Circuits & Syst, Minist Educ, Hangzhou 310018, Peoples R China
[2] 011 Res Ctr, Sci & Technol Commun Informat Secur Control Lab, Jiaxing 314033, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio; intelligent jamming; deep reinforcement learning; Wolpertinger architecture; soft actor-critic; COGNITIVE RADIO; WIRELESS NETWORKS;
D O I
10.3390/e24101441
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
引用
收藏
页数:22
相关论文
共 50 条
  • [41] Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraints
    Wang, Junjie
    Zhang, Qichao
    Zhao, Dongbin
    Chen, Yaran
    2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [42] Modeling Complex Networks Based on Deep Reinforcement Learning
    Song, Wenbo
    Sheng, Wei
    Li, Dong
    Wu, Chong
    Ma, Jun
    FRONTIERS IN PHYSICS, 2022, 9
  • [43] TWO-DIMENSIONAL ANTI-JAMMING COMMUNICATION BASED ON DEEP REINFORCEMENT LEARNING
    Han, Guoan
    Xiao, Liang
    Poor, H. Vincent
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 2087 - 2091
  • [44] An Improved Anti-Jamming Method Based on Deep Reinforcement Learning and Feature Engineering
    Chang, Xin
    Li, Yanbin
    Zhao, Yan
    Du, Yufeng
    Liu, Donghui
    IEEE ACCESS, 2022, 10 : 69992 - 70000
  • [45] Robust Deep Reinforcement Learning Based Network Slicing under Adversarial Jamming Attacks
    Wang, Feng
    Gursoy, M. Cenk
    Velipasalar, Senem
    Sagduyu, Yalin E.
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 752 - 757
  • [46] Airborne Radar Anti-Jamming Waveform Design Based on Deep Reinforcement Learning
    Zheng, Zexin
    Li, Wei
    Zou, Kun
    SENSORS, 2022, 22 (22)
  • [47] Deep Reinforcement Learning-Based Offloading Decision Optimization in Mobile Edge Computing
    Zhang, Hao
    Wu, Wenjun
    Wang, Chaoyi
    Li, Meng
    Yang, Ruizhe
    2019 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2019,
  • [48] Intelligent Vehicle Decision-Making and Trajectory Planning Method Based on Deep Reinforcement Learning in the Frenet Space
    Wang, Jiawei
    Chu, Liang
    Zhang, Yao
    Mao, Yabin
    Guo, Chong
    SENSORS, 2023, 23 (24)
  • [49] A Deep Reinforcement Learning Algorithm Based on Short-Term Advantage for Air Game Decision-Making
    Xie, RongLei
    Huang, ChengJing
    Wang, Ziyi
    Han, Jin
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 3884 - 3894
  • [50] Collaborative task decision-making of multi-UUV in dynamic environments based on deep reinforcement learning
    Yu, Haomiao
    Zhang, Sijie
    SHIPS AND OFFSHORE STRUCTURES, 2024,