Negotiation agent based on Deep reinforcement learning for multi-agent cooperative distributed predictive control.

被引:0
作者
Aponte-Rengifo, O. [1 ]
Francisco, M. [1 ]
Vega, P. [1 ]
机构
[1] Univ Salamanca, Dept Comp & Automat, Salamanca, Spain
关键词
Deep Neural Networks; Reinforcement Learning; DMPC; Multi-Agent systems;
D O I
10.1016/j.ifacol.2023.10.1844
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, deep neural network trained by the model-free reinforcement learning method is proposed as a negotiation agent in multi-agent distributive model predictive control. The negotiation agent is implemented in the upper layer of a hierarchical control architecture based on distributed model predictive controller with pairwise negotiation fuzzy logic. The proposed is data-driven in order to achieve the minimization of any dynamic behavior index and the specification of constraints. Specifically, the deep neural network provides consensus coefficients to address the final control action applied by each agent. The proposed is successfully applied to a hydraulic system composed of eight interconnected tanks that are very difficult to control due to non-linearities nature and high interaction between its subsystems. Copyright (c) 2023 The Authors.
引用
收藏
页码:1496 / 1501
页数:6
相关论文
共 12 条
[1]  
[Anonymous], 1996, YALE WORKSHOP ADAPTI
[2]   Distributed model predictive control: A tutorial review and future research directions [J].
Christofides, Panagiotis D. ;
Scattolini, Riccardo ;
Munoz de la Pena, David ;
Liu, Jinfeng .
COMPUTERS & CHEMICAL ENGINEERING, 2013, 51 :21-41
[3]   Reinforcement Learning for UAV Attitude Control [J].
Koch, William ;
Mancuso, Renato ;
West, Richard ;
Bestavros, Azer .
ACM TRANSACTIONS ON CYBER-PHYSICAL SYSTEMS, 2019, 3 (02)
[4]  
Lillicrap T. P., 2015, arXiv, DOI DOI 10.48550/ARXIV.1509.02971
[5]   Distributed model predictive control based on a cooperative game [J].
Maestre, J. M. ;
de la Pena, D. Munoz ;
Camacho, E. F. .
OPTIMAL CONTROL APPLICATIONS & METHODS, 2011, 32 (02) :153-176
[6]   Hierarchical distributed model predictive control based on fuzzy negotiation [J].
Masero, Eva ;
Francisco, Mario ;
Maestre, Jose M. ;
Revollar, Silvana ;
Vega, Pastora .
EXPERT SYSTEMS WITH APPLICATIONS, 2021, 176
[7]   A survey of industrial model predictive control technology [J].
Qin, SJ ;
Badgwell, TA .
CONTROL ENGINEERING PRACTICE, 2003, 11 (07) :733-764
[8]   A Tour of Reinforcement Learning: The View from Continuous Control [J].
Recht, Benjamin .
ANNUAL REVIEW OF CONTROL, ROBOTICS, AND AUTONOMOUS SYSTEMS, VOL 2, 2019, 2 :253-279
[9]  
Sutton RS, 2018, ADAPT COMPUT MACH LE, P1
[10]   Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning HOW TO SOLVE MULTIPLAYER GAMES ONLINE [J].
Vamvoudakis, Kyriakos G. ;
Modares, Hamidreza ;
Kiumarsi, Bahare ;
Lewis, Frank L. .
IEEE CONTROL SYSTEMS MAGAZINE, 2017, 37 (01) :33-52