A solution to Hamilton-Jacobi equation by neural networks and optimal state feedback control

被引:0
|
作者
Shimizu, K [1 ]
机构
[1] Keio Univ, Fac Sci & Technol, Tokyo 108, Japan
来源
Optimization And Control With Applications | 2005年 / 96卷
关键词
nonlinear optimal control; Hamilton-Jacobi equation; neural network; state feedback;
D O I
暂无
中图分类号
C93 [管理学]; O22 [运筹学];
学科分类号
070105 ; 12 ; 1201 ; 1202 ; 120202 ;
摘要
This paper is concerned with state feedback controller design using neural networks for nonlinear optimal regulator problem. Nonlinear optimal feedback control law can be synthesized by solving the Hamilton-Jacobi equation with three layered neural networks. The Hamilton-Jacobi equation generates the value function by which the optimal feedback law is synthesized. To obtain an approximate solution of the Hamilton-Jacobi equation, we solve an optimization problem by the gradient method, which determines connection weights and thresholds in the neural networks. Gradient functions are calculated explicitly by the Lagrange multiplier method and used in the learning algorithm of the networks. We propose also a device such that an approximate solution to the Hamilton-Jacobi equation converges to the true value function. The effectiveness of the proposed method was confirmed with simulations for various plants.
引用
收藏
页码:461 / 480
页数:20
相关论文
共 50 条
  • [1] A solution to Hamilton-Jacobi equation by neural networks and optimal state feedback control law of nonlinear systems
    Shimizu, K
    Nakayama, K
    PROCEEDINGS OF THE 2002 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 2002, 1-6 : 442 - 447
  • [2] Approximate solution of Hamilton-Jacobi inequality by neural networks
    Yang, XF
    Shen, TL
    Tamura, K
    APPLIED MATHEMATICS AND COMPUTATION, 1997, 84 (01) : 49 - 64
  • [3] Nonlinear optimal control: Alternatives to Hamilton-Jacobi equation
    Huang, Y
    Lu, WM
    PROCEEDINGS OF THE 35TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-4, 1996, : 3942 - 3947
  • [4] Multicriteria optimal control and vectorial Hamilton-Jacobi equation
    Caroff, Nathalie
    LARGE-SCALE SCIENTIFIC COMPUTING, 2008, 4818 : 293 - 299
  • [5] OPTIMAL TRAJECTORIES ASSOCIATED WITH A SOLUTION OF THE CONTINGENT HAMILTON-JACOBI EQUATION
    FRANKOWSKA, H
    APPLIED MATHEMATICS AND OPTIMIZATION, 1989, 19 (03): : 291 - 311
  • [6] HAMILTON-JACOBI EQUATIONS FOR OPTIMAL CONTROL ON JUNCTIONS AND NETWORKS
    Achdou, Yves
    Oudet, Salome
    Tchou, Nicoletta
    ESAIM-CONTROL OPTIMISATION AND CALCULUS OF VARIATIONS, 2015, 21 (03) : 876 - 899
  • [7] Asymptotic solution of a Hamilton-Jacobi equation
    Namah, G
    ASYMPTOTIC ANALYSIS, 1996, 12 (04) : 355 - 370
  • [8] Solving optimal feedback control problems by the Hamilton-Jacobi theory
    Park, Chandeok
    Scheeres, Daniel J.
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 2406 - +
  • [9] On a solution to the Cauchy problem for the Hamilton-Jacobi equation with state constraints
    Subbotina, N. N.
    Shagalova, L. G.
    TRUDY INSTITUTA MATEMATIKI I MEKHANIKI URO RAN, 2011, 17 (02): : 191 - 208
  • [10] GEOMETRY OF THE DISCRETE HAMILTON-JACOBI EQUATION: APPLICATIONS IN OPTIMAL CONTROL
    de Leon, Manuel
    Sardon, Cristina
    REPORTS ON MATHEMATICAL PHYSICS, 2018, 81 (01) : 39 - 63