A Multi-group Multi-agent System Based on Reinforcement Learning and Flocking

被引:5
作者
Wang, Gang [1 ]
Xiao, Jian [2 ,3 ]
Xue, Rui [4 ]
Yuan, Yongting [5 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Ctr Robot, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 611731, Peoples R China
[3] Univ Elect Sci & Technol China, Yangtze Delta Reg Inst Quzhou, Quzhou, Peoples R China
[4] Beihang Univ, Sch Elect & Informat Engn, Beijing 100191, Peoples R China
[5] 31435 Res Inst, Shenyang 110000, Peoples R China
基金
中国国家自然科学基金;
关键词
Distributed cooperative reinforcement learning; flocking; group confrontation; multi-group multi-agent system; SENSOR NETWORKS; MOBILE; ALGORITHMS; COVERAGE;
D O I
10.1007/s12555-021-0170-5
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we present an inter-group confrontation and intra-group cooperation method for a predator group and prey group, and construct a multi-group multi-agent system. We model the motion of the prey group using the flocking control algorithm. The prey group can cooperatively avoid predators and maintain the integrity of the group after the predators have been detected. The autonomous decision-making of the predator group is implemented based on the distributed reinforcement learning algorithm. To efficiently share the learning experience among agents in the predator group, a distributed cooperative reinforcement learning algorithm with variable weights is proposed to accelerate the convergence of the learning algorithm. Simulations show the feasibility of this proposed method.
引用
收藏
页码:2364 / 2378
页数:15
相关论文
共 50 条
[31]   Flocking Control of Multi-agent System With Leader-Follower Architecture Using Consensus Based Estimated Flocking Center [J].
Bhowmick, Chandreyee ;
Behera, Laxmidhar ;
Shukla, Amit ;
Karki, Hamad .
PROCEEDINGS OF THE IECON 2016 - 42ND ANNUAL CONFERENCE OF THE IEEE INDUSTRIAL ELECTRONICS SOCIETY, 2016, :166-171
[32]   Virtual Machine Migration Strategy Based on Multi-Agent Deep Reinforcement Learning [J].
Dai, Yu ;
Zhang, Qiuhong ;
Yang, Lei .
APPLIED SCIENCES-BASEL, 2021, 11 (17)
[33]   Multi-agent Reinforcement Learning-based Adaptive Heterogeneous DAG Scheduling [J].
Zhadan, Anastasia ;
Allahverdyan, Alexander ;
Kondratov, Ivan ;
Mikheev, Vikenty ;
Petrosian, Ovanes ;
Romanovskii, Aleksei ;
Kharin, Vitaliy .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (05)
[34]   A Distributed Multi-Agent Dynamic Area Coverage Algorithm Based on Reinforcement Learning [J].
Xiao, Jian ;
Wang, Gang ;
Zhang, Ying ;
Cheng, Lei .
IEEE ACCESS, 2020, 8 :33511-33521
[35]   Goal-Based Multi-Agent Tree Formation using Reinforcement Learning [J].
Prasad, B. K. Swathi ;
Ramasangu, Hariharan .
2017 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2017, :2180-2184
[36]   Stability analysis of flocking for multi-agent dynamic systems [J].
Sun, Yuangong .
NONLINEAR ANALYSIS-REAL WORLD APPLICATIONS, 2013, 14 (02) :1075-1081
[37]   Flocking in multi-agent systems with multiple virtual leaders [J].
Su, Housheng ;
Wang, Xiaofan ;
Wen Yang .
ASIAN JOURNAL OF CONTROL, 2008, 10 (02) :238-245
[38]   Flocking control of multi-agent systems in a limited space [J].
Jiang, Sharu ;
Jia, Yingmin ;
Long, Shichen .
PROCEEDINGS OF THE EIGHTEENTH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL LIFE AND ROBOTICS (AROB 18TH '13), 2013, :404-407
[39]   A multi-agent flocking oriented obstacle avoidance algorithm [J].
School of Information Science and Engineering, Northeastern University, Shenyang 110819, China .
Dongbei Daxue Xuebao, 3 (347-350) :347-350
[40]   Multi-agent Reinforcement Learning for Control Systems: Challenges and Proposals [J].
Grana, Manuel ;
Fernandez-Gauna, Borja .
INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2015, 2015, 9375 :18-25