Online optimal control of nonlinear discrete-time systems using approximate dynamic programming

被引：48

作者：

Dierks T. ^{[1
]}

Jagannathan S. ^{[2
]}

机构：

[1] DRS Sustainment Systems, Inc., St. Louis, MO 63121

[2] Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla

来源：

Journal of Control Theory and Applications | 2011年 / 9卷 / 3期

基金：

美国国家科学基金会;

关键词：

Discrete-time systems; Hamilton Jacobi-Bellman; Online approximators; Online nonlinear optimal control;

D O I：

10.1007/s11768-011-0178-0

中图分类号：

学科分类号：

摘要：

In this paper, the optimal control of a class of general affine nonlinear discrete-time (DT) systems is undertaken by solving the Hamilton Jacobi-Bellman (HJB) equation online and forward in time. The proposed approach, referred normally as adaptive or approximate dynamic programming (ADP), uses online approximators (OLAs) to solve the infinite horizon optimal regulation and tracking control problems for affine nonlinear DT systems in the presence of unknown internal dynamics. Both the regulation and tracking controllers are designed using OLAs to obtain the optimal feedback control signal and its associated cost function. Additionally, the tracking controller design entails a feedforward portion that is derived and approximated using an additional OLA for steady state conditions. Novel update laws for tuning the unknown parameters of the OLAs online are derived. Lyapunov techniques are used to show that all signals are uniformly ultimately bounded and that the approximated control signals approach the optimal control inputs with small bounded error. In the absence of OLA reconstruction errors, an optimal control is demonstrated. Simulation results verify that all OLA parameter estimates remain bounded, and the proposed OLA-based optimal control scheme tunes itself to reduce the cost HJB equation. © 2011 South China University of Technology, Academy of Mathematics and Systems Science, Chinese Academy of Sciences and Springer-Verlag Berlin Heidelberg.

引用

页码：361 / 369

页数：8

共 15 条

[11]

Dierks T., Thumati B.T., Jagannathan S., Optimal control of unknown affine nonlinear discrete-time systems using offline-trained neural networks with proof of convergence, Neural Networks, 22, 5-6, pp. 851-860, (2009)

[12]

Vamvoudakis K.G., Lewis F.L., Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem, Automatica, 46, 5, pp. 878-888, (2010)

[13]

Khalil H.K., Nonlinear Systems, (2002)

[14]

Wang D., Huang J., Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form, IEEE Transactions on Neural Networks, 16, 1, pp. 195-202, (2005)

[15]

Bugeja M.K., Fabri S.G., Camilleri L., Dual adaptive dynamic control of mobile robots using nearal networks, IEEE Transactions on Systems, Man, and Cybernetics - Part B, 39, 1, pp. 129-141, (2009)

← 1 2 →