Event-Based Control Using Quadratic Approximate Value Functions

被引:36
作者
Cogill, Randy [1 ]
机构
[1] Univ Virginia, Dept Syst & Informat Engn, Charlottesville, VA 22903 USA
来源
PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009) | 2009年
关键词
D O I
10.1109/CDC.2009.5400345
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper we consider several problems involving control with limited actuation and sampling rates. Event-based control has emerged as an attractive approach for addressing the problems of control system design under rate limitations. In event-based control, a system is actuated or a control signal is changed only when certain events occur. For example, a control signal might be applied only when some measure of deviation of the system state from equilibrium is exceeded. Thus, control action is only applied when it is needed, keeping control performance satisfactory while reducing the rate that the system must be sensed and actuated. In principle, the problem of determining how to optimally schedule the sensing or actuation of a system can be cast as a Markov decision process. However, the optimal value function for these Markov decision processes generally does not have a simple structure. So, determining a closed-form expression or simple parametrization of the optimal value function is generally not possible. In this paper we develop new computational methods for event-based control. Under a given policy, one can obtain an upper bound on control performance using an approximate value function for the associated Markov decision process.We will consider performance bounds that can be obtained using quadratic approximate value functions. We will find the policy that minimizes the upper bound obtainable over all possible quadratic approximate value functions. This policy and the associated performance bound can be obtained by solving a sequence of semidefinite programs indexed by a scalar parameter.
引用
收藏
页码:5883 / 5888
页数:6
相关论文
共 19 条
  • [1] [Anonymous], P 2007 AM CONTR C
  • [2] DISCRETE-TIME CONTROLLED MARKOV-PROCESSES WITH AVERAGE COST CRITERION - A SURVEY
    ARAPOSTATHIS, A
    BORKAR, VS
    FERNANDEZGAUCHERAND, E
    GHOSH, MK
    MARCUS, SI
    [J]. SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 1993, 31 (02) : 282 - 344
  • [3] Astrom K.J., 2002, ANAL DESIGN NONLINEA
  • [4] Astrom K. J., 2002, P IEEE C DEC CONTR S
  • [5] Boyd S., 1994, LINEAR MATRIX INEQUA
  • [6] Cervin A., 2008, P 17 IFAC WORLD C
  • [7] Cervin A, 2007, IEEE DECIS CONTR P, P1947
  • [8] Suboptimality bounds in stochastic control: A queueing example
    Cogill, Randy
    Lall, Sanjay
    [J]. 2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 1642 - +
  • [9] Hristu-Varsakelis D., 2002, P IEEE C DEC CONTR S
  • [10] Imer OC, 2005, IEEE DECIS CONTR P, P1029