An overview: Attention mechanisms in multi-agent reinforcement learning

被引:15
作者
Hu, Kai [1 ,2 ]
Xu, Keer [1 ,3 ]
Xia, Qingfeng [3 ]
Li, Mingyang [1 ,3 ]
Song, Zhiqiang [3 ]
Song, Lipeng [1 ,3 ]
Sun, Ning [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol NUIST, Sch Automat, Nanjing 210044, Peoples R China
[2] NUIST, CICAEET, Nanjing 210044, Peoples R China
[3] Wuxi Univ, Sch Automat, Wuxi 214000, Peoples R China
关键词
Reinforcement learning; Attention mechanism; Multi-agent system; COMMUNICATION; COORDINATION; NETWORK;
D O I
10.1016/j.neucom.2024.128015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, in the field of Multi-Agent Systems (MAS), significant progress has been made in the research of algorithms that combine Reinforcement Learning (RL) with Attention Mechanism (AM). However, there is a lack of comprehensive reviews in this field. Based on this, this paper does the following work. Firstly, it reviews the classical algorithms of RL and AM; Secondly, it systematically introduces the combination of RL and AM; Thirdly, it sorts out their application in the field of single-agent and multi-agent, and pays attention to and looks forward to the challenges and future research prospects in this field; The last part offers a comprehensive analysis of the challenges encountered by research in this field and anticipates future research paths. The research offers a conceptual understanding and theoretical foundation for future applications of RL using AM and facilitates further in-depth study in this field for researchers.
引用
收藏
页数:40
相关论文
共 156 条
[1]   Reinforcement Learning Techniques for Optimal Power Control in Grid-Connected Microgrids: A Comprehensive Review [J].
Arwa, Erick O. ;
Folly, Komla A. .
IEEE ACCESS, 2020, 8 :208992-209007
[2]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, 10.48550/arXiv.1409.0473, DOI 10.48550/ARXIV.1409.0473]
[3]  
Bai YY, 2023, APPL ENERG, V330, DOI 10.1016/j.apenergy.2022.120294
[4]   Solving Multi-Agent Routing Problems Using Deep Attention Mechanisms [J].
Bono, Guillaume ;
Dibangoye, Jilles S. ;
Simonin, Olivier ;
Matignon, Laetitia ;
Pereyron, Florian .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (12) :7804-7813
[5]   A comprehensive survey of multiagent reinforcement learning [J].
Busoniu, Lucian ;
Babuska, Robert ;
De Schutter, Bart .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (02) :156-172
[6]  
Busoniu L, 2010, STUD COMPUT INTELL, V310, P183
[7]  
Chen chaoyi, 2022, Computer Engineering and Applications, P23, DOI 10.3778/j.issn.1002-8331.2108-0266
[8]  
[陈海涵 Chen Haihan], 2021, [计算机工程与科学, Computer Engineering and Science], V43, P370
[9]   GAMA: Graph Attention Multi-agent reinforcement learning algorithm for cooperation [J].
Chen, Haoqiang ;
Liu, Yadong ;
Zhou, Zongtan ;
Hu, Dewen ;
Zhang, Ming .
APPLIED INTELLIGENCE, 2020, 50 (12) :4195-4205
[10]  
Chen KY, 2023, IEEE T GEOSCI REMOTE, V61, DOI [10.1109/TGRS.2023.3283435, 10.1109/TGRS.2023.3272473]