An Online Event-Triggered Near-Optimal Controller for Nash Solution in Interconnected System

被引:12
作者
Dhar, Narendra Kumar [1 ]
Verma, Nishchal Kumar [1 ]
Behera, Laxmidhar [1 ]
机构
[1] IIT Kanpur, Dept Elect Engn, Kanpur 208016, Uttar Pradesh, India
关键词
Games; Nash equilibrium; Cost function; Nonlinear dynamical systems; Interconnected systems; Control systems; Artificial neural networks; Actor-critic neural network (NN); discrete-time system; event-trigger; heating; ventilation; air-conditioning (HVAC) system; Nash solution; near-optimal control; stability; DIFFERENTIAL GRAPHICAL GAMES; ADAPTIVE LEARNING SOLUTION; ALGORITHM; CONSENSUS;
D O I
10.1109/TNNLS.2020.2969249
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article proposes a real-time event-triggered near-optimal controller for the nonlinear discrete-time interconnected system. The interconnected system has a number of subsystems/agents, which pose a nonzero-sum game scenario. The control inputs/policies based on proposed event-based controller methodology attain a Nash equilibrium fulfilling the desired goal of the system. The near-optimal control policies are generated online only at events using actor-critic neural network architecture whose weights are updated too at the same instants. The approach ensures stability as the event-triggering condition for agents is derived using Lyapunov stability analysis. The lower bound on interevent time, boundedness of closed-loop parameters, and optimality of the proposed controller are also guaranteed. The efficacy of the proposed approach has been validated on a practical heating, ventilation, and air-conditioning system for achieving the desired temperature set in four zones of a building. The control update instants are minimized to as low as 27% for the desired temperature set.
引用
收藏
页码:5534 / 5548
页数:15
相关论文
共 39 条
  • [1] Multi-agent discrete-time graphical games and reinforcement learning solutions
    Abouheaf, Mohammed I.
    Lewis, Frank L.
    Vamvoudakis, Kyriakos G.
    Haesaert, Sofie
    Babuska, Robert
    [J]. AUTOMATICA, 2014, 50 (12) : 3038 - 3053
  • [2] [Anonymous], 1998, INTRO REINFORCEMENT
  • [3] Basar T., 1999, CLASSIFICATION APPL, V2nd
  • [4] Distributed Dynamic Event-Triggered Coordination with a Designable Minimum Inter-Event Time
    Berneburg, James
    Nowzari, Cameron
    [J]. 2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, : 1424 - 1429
  • [5] COMPARISON PRINCIPLE, POSITIVE INVARIANCE AND CONSTRAINED REGULATION OF NONLINEAR-SYSTEMS
    BITSORIS, G
    GRAVALOU, E
    [J]. AUTOMATICA, 1995, 31 (02) : 217 - 222
  • [6] On an Integrated Approach to Networked Climate Control of a Smart Home
    Dhar, Narendra Kumar
    Verma, Nishchal Kumar
    Behera, Laxmidhar
    Jamshidi, Mo M.
    [J]. IEEE SYSTEMS JOURNAL, 2018, 12 (02): : 1317 - 1328
  • [7] Adaptive Critic-Based Event-Triggered Control for HVAC System
    Dhar, Narendra Kumar
    Verma, Nishchal Kumar
    Behera, Laxmidhar
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2018, 14 (01) : 178 - 188
  • [8] Dierks T, 2010, P AMER CONTR CONF, P1568
  • [9] Distributed Event-Triggered Control for Multi-Agent Systems
    Dimarogonas, Dimos V.
    Frazzoli, Emilio
    Johansson, Karl H.
    [J]. IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (05) : 1291 - 1297
  • [10] Decentralised event-triggered cooperative control with limited communication
    Garcia, Eloy
    Cao, Yongcan
    Yu, Han
    Antsaklis, Panos
    Casbeer, David
    [J]. INTERNATIONAL JOURNAL OF CONTROL, 2013, 86 (09) : 1479 - 1488