Deep Reinforcement Learning Based Decision Making for Complex Jamming Waveforms

被引:2
作者
Xu, Yuting [1 ]
Wang, Chao [1 ]
Liang, Jiakai [1 ]
Yue, Keqiang [1 ,2 ]
Li, Wenjun [1 ]
Zheng, Shilian [2 ]
Zhao, Zhijin [3 ]
机构
[1] Hangzhou Dianzi Univ, Key Lab RF Circuits & Syst, Minist Educ, Hangzhou 310018, Peoples R China
[2] 011 Res Ctr, Sci & Technol Commun Informat Secur Control Lab, Jiaxing 314033, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
cognitive radio; intelligent jamming; deep reinforcement learning; Wolpertinger architecture; soft actor-critic; COGNITIVE RADIO; WIRELESS NETWORKS;
D O I
10.3390/e24101441
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
With the development of artificial intelligence, intelligent communication jamming decision making is an important research direction of cognitive electronic warfare. In this paper, we consider a complex intelligent jamming decision scenario in which both communication parties choose to adjust physical layer parameters to avoid jamming in a non-cooperative scenario and the jammer achieves accurate jamming by interacting with the environment. However, when the situation becomes complex and large in number, traditional reinforcement learning suffers from the problems of failure to converge and a high number of interactions, which are fatal and unrealistic in a real warfare environment. To solve this problem, we propose a deep reinforcement learning based and maximum-entropy-based soft actor-critic (SAC) algorithm. In the proposed algorithm, we add an improved Wolpertinger architecture to the original SAC algorithm in order to reduce the number of interactions and improve the accuracy of the algorithm. The results show that the proposed algorithm shows excellent performance in various scenarios of jamming and achieves accurate, fast, and continuous jamming for both sides of the communication.
引用
收藏
页数:22
相关论文
共 50 条
  • [31] Improved deep reinforcement learning for car-following decision-making
    Yang, Xiaoxue
    Zou, Yajie
    Zhang, Hao
    Qu, Xiaobo
    Chen, Lei
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2023, 624
  • [32] Deep reinforcement learning augmented decision⁃making model for intelligent driving vehicles
    Tian Y.-T.
    Ji Y.-S.
    Chang H.
    Xie B.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2023, 53 (03): : 682 - 692
  • [33] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Guofa Li
    Shenglong Li
    Shen Li
    Yechen Qin
    Dongpu Cao
    Xingda Qu
    Bo Cheng
    Automotive Innovation, 2020, 3 : 374 - 385
  • [34] Deep Reinforcement Learning Enabled Decision-Making for Autonomous Driving at Intersections
    Li, Guofa
    Li, Shenglong
    Li, Shen
    Qin, Yechen
    Cao, Dongpu
    Qu, Xingda
    Cheng, Bo
    AUTOMOTIVE INNOVATION, 2020, 3 (04) : 374 - 385
  • [35] Collision avoidance decision-making strategy for multiple USVs based on Deep Reinforcement Learning algorithm
    Cui, Zhewen
    Guan, Wei
    Zhang, Xianku
    OCEAN ENGINEERING, 2024, 308
  • [36] On the Performance of Deep Reinforcement Learning-Based Anti-Jamming Method Confronting Intelligent Jammer
    Li, Yangyang
    Wang, Ximing
    Liu, Dianxiong
    Guo, Qiuju
    Liu, Xin
    Zhang, Jie
    Xu, Yitao
    APPLIED SCIENCES-BASEL, 2019, 9 (07):
  • [37] Deep Reinforcement Learning-Based Air Defense Decision-Making Using Potential Games
    Zhao, Minrui
    Wang, Gang
    Fu, Qiang
    Guo, Xiangke
    Li, Tengda
    ADVANCED INTELLIGENT SYSTEMS, 2023, 5 (10)
  • [38] Workload-based adaptive decision-making for edge server layout with deep reinforcement learning
    Li, Shihua
    Zhou, Yanjie
    Zhou, Bing
    Wang, Zongmin
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 139
  • [39] Deep Reinforcement Learning-Based Decision Making of Lane Change Considering Rear Vehicle Deceleration
    Jo G.-H.
    Park T.-H.
    Journal of Institute of Control, Robotics and Systems, 2022, 28 (06) : 602 - 607
  • [40] A Comprehensive Driving Decision-Making Methodology Based on Deep Reinforcement Learning for Automated Commercial Vehicles
    Hu, Weiming
    Li, Xu
    Hu, Jinchao
    Liu, Yan
    Zhou, Jinying
    INTERNATIONAL JOURNAL OF AUTOMOTIVE TECHNOLOGY, 2024, 25 (06) : 1469 - 1483