Action-Dependent Updated Terminal Cost Receding Horizon Control for Discrete-Time Linear Systems

被引：0

作者：

Moon, Mi Youn ^{[1
]}

Lee, Jae Young ^{[1
]}

Park, Jin Bae ^{[1
]}

Choi, Yoon Ho ^{[2
]}

机构：

[1] Yonsei Univ, Dept Elect & Elect Engn, Seoul 120749, South Korea

[2] Kyonggi Univ, Dept Elect Engn, Kyonggi 443760, South Korea

来源：

2012 12TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS) | 2012年

关键词：

Action-dependent updated terminal cost receding horizon control; receding horizon control; adaptive dynamic programming; action-dependent heuristic dynamic programming; Q-function; PREDICTIVE CONTROL; DESIGNS;

D O I：

暂无

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In case of linear quadratic regulator (LQR), the updated terminal cost receding horizon control (UTC-RHC) enhances the standard RHC in terms of the stability and the convergence to the optimal solution. Based on the action-dependent (AD) value functions, known as Q-function, this paper proposes two modified RHC methods, AD-RHC and AD-UTC-RHC and proves the stability and convergence by using the matrix equivalence of the established control schemes. Additionally, in case of the horizon size N = 1, as like UTC-RHC is connected with heuristic dynamic programming (HDP), we shows the connection between the AD-UTC-RHC and ADHDP which has the learning abilities of the optimal solution without using the explicit descriptions of the system dynamics.

引用

页码：896 / 901

页数：6

共 9 条

[1] Model-free Q-learning designs for linear discrete-time zero-sum games with application to H-infinity control [J].

Al-Tamimi, Asma ;

Lewis, Frank L. ;

Abu-Khalaf, Murad .

AUTOMATICA, 2007, 43 (03) :473-481

[2]

Bertsekas D. P., 2005, DYNAMIC PROGRAMMING, P1

[3] CONSTRAINED RECEDING-HORIZON PREDICTIVE CONTROL [J].

CLARKE, DW ;

SCATTOLINI, R .

IEE PROCEEDINGS-D CONTROL THEORY AND APPLICATIONS, 1991, 138 (04) :347-354

[4]

Freiling G, 1996, LINEAR ALGEBRA APPL, V243, P291

[5] On the stability of receding horizon control with a general terminal cost [J].

Jadbabaie, A ;

Hauser, J .

IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2005, 50 (05) :674-678

[6] Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control [J].

Lewis, Frank L. ;

Vrabie, Draguna .

IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2009, 9 (03) :32-50

[7] MODEL PREDICTIVE CONTROL WITH LINEAR-MODELS [J].

MUSKE, KR ;

RAWLINGS, JB .

AICHE JOURNAL, 1993, 39 (02) :262-287

[8] Adaptive critic designs [J].

Prokhorov, DV ;

Wunsch, DC .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (05) :997-1007

[9]

Zhang HW, 2009, ADPRL: 2009 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING, P28

← 1 →