Deterministic Policy Gradient Based Formation Control for Multi-Agent Systems

被引:0
作者
Hong, Zhiying [1 ]
Wang, Qingling [1 ]
机构
[1] Southeast Univ, Sch Automat, Nanjing, Peoples R China
来源
2019 CHINESE AUTOMATION CONGRESS (CAC2019) | 2019年
关键词
formation control; multi-agent reinforcement learning; deterministic policy gradient;
D O I
10.1109/cac48633.2019.8996660
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the problem of formation control of multi-agent systems with the reinforcement learning method. A novel multi-agent formation control algorithm is first proposed, which adopts the framework of centralized training with decentralized execution, and combines the deterministic policy gradient (DPG) method with multi-agent advantage function. Then, three scenarios under partial observable Markov games are presented to study the multi-agent formation control problem and verify the proposed algorithm. Simulation results show that the proposed algorithm is effective in achieving the multi-agent formation control tasks.
引用
收藏
页码:4349 / 4354
页数:6
相关论文
共 50 条
[11]   Formation Control with Mismatched Orientation in Multi-Agent Systems [J].
Li, Zhen ;
Tang, Yang ;
Huang, Tingwen ;
Kurths, Juergen .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2019, 6 (03) :314-325
[12]   Distributed rotating formation control of multi-agent systems [J].
Lin, Peng ;
Jia, Yingmin .
SYSTEMS & CONTROL LETTERS, 2010, 59 (10) :587-595
[13]   Formation Control of Multi-Agent Systems With Orientation Noises [J].
Li, Zhen ;
Tang, Yang ;
Fang, Jian-an ;
Huang, Tingwen .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2021, 8 (01) :305-317
[14]   Bearing-based formation manoeuvre control of nonholonomic multi-agent systems [J].
Li, Xiaolei ;
Er, Meng Loo ;
Yang, Guanghong ;
Wang, Ning .
INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2019, 50 (16) :2993-3002
[15]   Formation control and collision avoidance for multi-agent systems based on position estimation [J].
Xia, Yuanqing ;
Na, Xitai ;
Sun, Zhongqi ;
Chen, Jing .
ISA TRANSACTIONS, 2016, 61 :287-296
[16]   Adaptive robust bearing-based formation control for multi-agent systems [J].
Cheng, Haoshu ;
Huang, Jie .
AUTOMATICA, 2024, 162
[17]   Trajectory Tracking and Formation Control Based on Consensus in Networked Multi-agent Systems [J].
Su Saijun ;
Nian Xiaohong ;
Pan Huan .
PROCEEDINGS OF THE 29TH CHINESE CONTROL CONFERENCE, 2010, :4465-4470
[18]   Leader-follower configuration based formation control of multi-agent systems [J].
Naufaldo, Hsiu-Ming ;
Wu, Hsiu-Ming ;
Zaman, Muhammad Qomaruz .
JOURNAL OF THE CHINESE INSTITUTE OF ENGINEERS, 2025,
[19]   Formation control and obstacles avoidance for multi-agent systems based on position estimation [J].
Chen, Jing ;
Xia, Yuanqing .
2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, :1150-1155
[20]   Spatial barycentric coordinates based distributed formation control for multi-agent systems [J].
Li, Fangyuan ;
Ning, Jialing ;
Liu, Hui ;
Zhang, Yubo ;
Liu, Yanhong .
ISA TRANSACTIONS, 2025, 156 :333-343