Deterministic Policy Gradient Based Formation Control for Multi-Agent Systems

被引:0
作者
Hong, Zhiying [1 ]
Wang, Qingling [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing, Peoples R China
来源
2019 CHINESE AUTOMATION CONGRESS (CAC2019) | 2019年
关键词
formation control; multi-agent reinforcement learning; deterministic policy gradient;
D O I
10.1109/cac48633.2019.8996660
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the problem of formation control of multi-agent systems with the reinforcement learning method. A novel multi-agent formation control algorithm is first proposed, which adopts the framework of centralized training with decentralized execution, and combines the deterministic policy gradient (DPG) method with multi-agent advantage function. Then, three scenarios under partial observable Markov games are presented to study the multi-agent formation control problem and verify the proposed algorithm. Simulation results show that the proposed algorithm is effective in achieving the multi-agent formation control tasks.
引用
收藏
页码:4349 / 4354
页数:6
相关论文
共 50 条
[21]   Research on Bidding Strategy of Thermal Power Companies in Electricity Market Based on Multi-Agent Deep Deterministic Policy Gradient [J].
Liu, Dunnan ;
Gao, Yuan ;
Wang, Weiye ;
Dong, Zhixin .
IEEE ACCESS, 2021, 9 :81750-81764
[22]   Optimization of formation for multi-agent systems based on LQR [J].
Chang-bin Yu ;
Yin-qiu Wang ;
Jin-liang Shao .
Frontiers of Information Technology & Electronic Engineering, 2016, 17 :96-109
[23]   Optimization of formation for multi-agent systems based on LQR [J].
Yu, Chang-bin ;
Wang, Yin-qiu ;
Shao, Jin-liang .
FRONTIERS OF INFORMATION TECHNOLOGY & ELECTRONIC ENGINEERING, 2016, 17 (02) :96-109
[24]   Optimization of formation for multi-agent systems based on LQR [J].
Chang-bin YU ;
Yin-qiu WANG ;
Jin-liang SHAO .
FrontiersofInformationTechnology&ElectronicEngineering, 2016, 17 (02) :96-109
[25]   Formation deployment control of multi-agent systems modeled with PDE [J].
Zhang, Sai ;
Tang, Li ;
Liu, Yan-Jun .
MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2022, 19 (12) :13541-13559
[26]   Distributed rigid formation control algorithm for multi-agent systems [J].
Cao, Hu ;
Bai, Yongqiang ;
Liu, Huagang .
KYBERNETES, 2012, 41 (10) :1650-1661
[27]   Formation Control Strategy of Multi-agent Systems with Obstacle Avoidance [J].
Li, Jingcheng ;
Zhang, Changzhu ;
Huang, Chao ;
Zhang, Hao ;
Wang, Zhuping ;
Kong, Deyang .
2020 12TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2020, :138-143
[28]   Multi-Agent Cluster Systems Formation Control with Obstacle Avoidance [J].
Sun, Yi ;
Hu, Xiaoguang ;
Xiao, Jin ;
Zhang, Guofeng ;
Wang, Shaojie ;
Liu, Lei .
PROCEEDINGS OF THE 15TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2020), 2020, :1635-1640
[29]   Formation Control of Multi-Agent Systems With Constrained Mismatched Compasses [J].
Li, Zhen ;
Tang, Yang ;
Fan, Yongqing ;
Huang, Tingwen ;
Rutkowski, Leszek .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04) :2224-2236
[30]   Event-triggered Formation Control of Multi-Agent Systems [J].
Tang Tao ;
Liu Zhongxin ;
Chen Zengqiang .
2011 30TH CHINESE CONTROL CONFERENCE (CCC), 2011, :4783-4786