An Online Event-Triggered Near-Optimal Controller for Nash Solution in Interconnected System

被引:12
作者
Dhar, Narendra Kumar [1 ]
Verma, Nishchal Kumar [1 ]
Behera, Laxmidhar [1 ]
机构
[1] IIT Kanpur, Dept Elect Engn, Kanpur 208016, Uttar Pradesh, India
关键词
Games; Nash equilibrium; Cost function; Nonlinear dynamical systems; Interconnected systems; Control systems; Artificial neural networks; Actor-critic neural network (NN); discrete-time system; event-trigger; heating; ventilation; air-conditioning (HVAC) system; Nash solution; near-optimal control; stability; DIFFERENTIAL GRAPHICAL GAMES; ADAPTIVE LEARNING SOLUTION; ALGORITHM; CONSENSUS;
D O I
10.1109/TNNLS.2020.2969249
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article proposes a real-time event-triggered near-optimal controller for the nonlinear discrete-time interconnected system. The interconnected system has a number of subsystems/agents, which pose a nonzero-sum game scenario. The control inputs/policies based on proposed event-based controller methodology attain a Nash equilibrium fulfilling the desired goal of the system. The near-optimal control policies are generated online only at events using actor-critic neural network architecture whose weights are updated too at the same instants. The approach ensures stability as the event-triggering condition for agents is derived using Lyapunov stability analysis. The lower bound on interevent time, boundedness of closed-loop parameters, and optimality of the proposed controller are also guaranteed. The efficacy of the proposed approach has been validated on a practical heating, ventilation, and air-conditioning system for achieving the desired temperature set in four zones of a building. The control update instants are minimized to as low as 27% for the desired temperature set.
引用
收藏
页码:5534 / 5548
页数:15
相关论文
共 39 条
[1]   Multi-agent discrete-time graphical games and reinforcement learning solutions [J].
Abouheaf, Mohammed I. ;
Lewis, Frank L. ;
Vamvoudakis, Kyriakos G. ;
Haesaert, Sofie ;
Babuska, Robert .
AUTOMATICA, 2014, 50 (12) :3038-3053
[2]  
Basar T., 1999, CLASSIFICATION APPL, V2nd
[3]   Distributed Dynamic Event-Triggered Coordination with a Designable Minimum Inter-Event Time [J].
Berneburg, James ;
Nowzari, Cameron .
2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, :1424-1429
[4]   COMPARISON PRINCIPLE, POSITIVE INVARIANCE AND CONSTRAINED REGULATION OF NONLINEAR-SYSTEMS [J].
BITSORIS, G ;
GRAVALOU, E .
AUTOMATICA, 1995, 31 (02) :217-222
[5]   On an Integrated Approach to Networked Climate Control of a Smart Home [J].
Dhar, Narendra Kumar ;
Verma, Nishchal Kumar ;
Behera, Laxmidhar ;
Jamshidi, Mo M. .
IEEE SYSTEMS JOURNAL, 2018, 12 (02) :1317-1328
[6]   Adaptive Critic-Based Event-Triggered Control for HVAC System [J].
Dhar, Narendra Kumar ;
Verma, Nishchal Kumar ;
Behera, Laxmidhar .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (01) :178-188
[7]  
Dierks T, 2010, P AMER CONTR CONF, P1568
[8]   Distributed Event-Triggered Control for Multi-Agent Systems [J].
Dimarogonas, Dimos V. ;
Frazzoli, Emilio ;
Johansson, Karl H. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (05) :1291-1297
[9]   Decentralised event-triggered cooperative control with limited communication [J].
Garcia, Eloy ;
Cao, Yongcan ;
Yu, Han ;
Antsaklis, Panos ;
Casbeer, David .
INTERNATIONAL JOURNAL OF CONTROL, 2013, 86 (09) :1479-1488
[10]   Event-driven multi-consensus of multi-agent networks with repulsive links [J].
Hu, Bin ;
Guan, Zhi-Hong ;
Jiang, Xiao-Wei ;
Chi, Ming ;
Liao, Rui-Quan ;
Chen, Chao-Yang .
INFORMATION SCIENCES, 2016, 373 :110-123