A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

被引:123
|
作者
Yao, Fuqiang [1 ]
Jia, Luliang [2 ]
机构
[1] Natl Univ Def Technol, Res Inst 63, Nanjing 210007, Jiangsu, Peoples R China
[2] Space Engn Univ, Sch Space Informat, Beijing 101416, Peoples R China
关键词
Anti-jamming; multi-agent reinforcement learning; Q-learning; Markov game; STACKELBERG GAME;
D O I
10.1109/LWC.2019.2904486
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we investigate the anti-jamming defense problem in multi-user scenarios, where the coordination among users is taken into consideration. The Markov game framework is employed to model and analyze the anti-jamming defense problem, and a collaborative multi-agent anti-jamming algorithm (CMAA) is proposed to obtain the optimal anti-jamming strategy. In sweep jamming scenarios, on the one hand, the proposed CMAA can tackle the external malicious jamming. On the other hand, it can effectively cope with the mutual interference among users. Moreover, we consider the impact of sensing errors due to miss detection and false alarm. Simulation results show that the proposed CMAA is superior to both sensing-based method and independent Q-learning method, and has the highest normalized rate.
引用
收藏
页码:1024 / 1027
页数:4
相关论文
共 50 条
  • [1] Intelligent Anti-Jamming Communication for Wireless Sensor Networks: A Multi-Agent Reinforcement Learning Approach
    Zhou Q.
    Li Y.
    Niu Y.
    Niu, Yingtao (niuyingtao78@163.com), 2021, Institute of Electrical and Electronics Engineers Inc. (02): : 775 - 784
  • [2] Enhanced Radar Anti-Jamming With Multi-Agent Reinforcement Learning
    Peng, Wenshen
    He, Chuan
    Cao, Fei
    Hu, Changhua
    Jiao, Licheng
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 3114 - 3118
  • [3] Multi-agent Reinforcement Learning Based Cognitive Anti-jamming
    Aref, Mohamed A.
    Jayaweera, Sudharman K.
    Machuzak, Stephen
    2017 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2017,
  • [4] A multi-agent reinforcement learning anti-jamming method with partially overlapping channels
    Zhang, Yunpeng
    Jia, Luliang
    Qi, Nan
    Xu, Yifan
    Chen, Xueqiang
    IET COMMUNICATIONS, 2021, 15 (19) : 2461 - 2468
  • [5] GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network
    Chen, Miaojiang
    Liu, Wei
    Zhang, Ning
    Li, Junling
    Ren, Yingying
    Yi, Meng
    Liu, Anfeng
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
  • [6] Mean-Field Multi-Agent Reinforcement Learning for Adaptive Anti-Jamming Channel Selection in UAV Communications
    Du, Feng
    Li, Jun
    Lin, Yan
    Wang, Zhe
    Qian, Yuwen
    2022 14TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING, WCSP, 2022, : 910 - 915
  • [7] Mean-Field Multi-Agent Reinforcement Learning for Adaptive Anti-Jamming Channel Selection in UAV Communications
    Du, Feng
    Li, Jun
    Lin, Yan
    Wang, Zhe
    Qian, Yuwen
    2022 IEEE 14th International Conference on Wireless Communications and Signal Processing, WCSP 2022, 2022, : 910 - 915
  • [8] Multi-agent Learning based Anti-jamming Communications Against Cognitive Jammers
    Jayaweera, Milidu N.
    2021 30TH WIRELESS AND OPTICAL COMMUNICATIONS CONFERENCE (WOCC 2021), 2021, : 122 - 126
  • [9] (T, ε)-GREEDY REINFORCEMENT LEARNING FOR ANTI-JAMMING WIRELESS COMMUNICATIONS
    Ye, Pei-Gen
    Wang, Yuan-Gen
    Li, Jin
    Xiao, Liang
    Zhu, Guopu
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [10] Collaborative Anti-jamming Algorithm Based on Q-learning in Wireless Communication Network
    Zhang, Guoliang
    Li, Yonggui
    Jia, Luliang
    Niu, Yingtao
    Zhou, Quan
    Pu, Ziming
    2022 IEEE 2ND INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND ARTIFICIAL INTELLIGENCE (CCAI 2022), 2022, : 222 - 226