A Collaborative Multi-Agent Reinforcement Learning Anti-Jamming Algorithm in Wireless Networks

被引:139
作者
Yao, Fuqiang [1 ]
Jia, Luliang [2 ]
机构
[1] Natl Univ Def Technol, Res Inst 63, Nanjing 210007, Jiangsu, Peoples R China
[2] Space Engn Univ, Sch Space Informat, Beijing 101416, Peoples R China
关键词
Anti-jamming; multi-agent reinforcement learning; Q-learning; Markov game; STACKELBERG GAME;
D O I
10.1109/LWC.2019.2904486
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this letter, we investigate the anti-jamming defense problem in multi-user scenarios, where the coordination among users is taken into consideration. The Markov game framework is employed to model and analyze the anti-jamming defense problem, and a collaborative multi-agent anti-jamming algorithm (CMAA) is proposed to obtain the optimal anti-jamming strategy. In sweep jamming scenarios, on the one hand, the proposed CMAA can tackle the external malicious jamming. On the other hand, it can effectively cope with the mutual interference among users. Moreover, we consider the impact of sensing errors due to miss detection and false alarm. Simulation results show that the proposed CMAA is superior to both sensing-based method and independent Q-learning method, and has the highest normalized rate.
引用
收藏
页码:1024 / 1027
页数:4
相关论文
共 18 条
[1]  
[Anonymous], ARXIV180904374
[2]  
[Anonymous], 2018, APPL SCI
[3]  
[Anonymous], IEEE WCNC
[4]  
[Anonymous], 2007, Markov Decision Processes with Their Applications
[5]  
[Anonymous], WIRELESS NETW
[6]  
[Anonymous], 2015, P 2015 INT C MIL COM
[7]  
Aref MA, 2017, 2017 IEEE 16TH INTERNATIONAL CONFERENCE ON COGNITIVE INFORMATICS & COGNITIVE COMPUTING (ICCI*CC), P520, DOI 10.1109/ICCI-CC.2017.8109798
[8]   A comprehensive survey of multiagent reinforcement learning [J].
Busoniu, Lucian ;
Babuska, Robert ;
De Schutter, Bart .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (02) :156-172
[9]   Jamming and anti-jamming techniques in wireless networks: a survey [J].
Grover, Kanika ;
Lim, Alvin ;
Yang, Qing .
INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2014, 17 (04) :197-215
[10]  
Jayaweera Sudharman K., 2016, IEEE INT C COMMUNICA