Reinforcement learning-based intelligent tracking control for wheeled mobile robot

被引:28
作者
Nguyen Tan Luy [1 ]
Nguyen Thien Thanh [2 ]
Hoang Minh Tri [2 ]
机构
[1] Ind Univ Ho Chi Minh City, Ho Chi Minh City, Vietnam
[2] Ho Chi Minh City Univ Technol, Ho Chi Minh City, Vietnam
关键词
Actor critic; Hamilton-Jacobi-Isaacs equation; neural network; wheeled mobile robot; NONLINEAR-SYSTEMS;
D O I
10.1177/0142331213509828
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a new method to design a reinforcement learning-based integrated kinematic and dynamic tracking control algorithm for a non-holonomic wheeled mobile robot without knowledge of the system's drift tracking dynamics. The actor critic structure in the control scheme uses only one neural network to reduce computational cost and storage resources. A novel tuning law for a single neural network is designed to learn an online solution of a tracking Hamilton-Jacobi-Isaacs (HJI) equation. The HJI solution is used to approximate an H-infinity optimal tracking performance index function and an intelligent tracking control law in the case of the worst disturbance. The laws guarantee closed-loop stability in real time. The convergence and stability of the overall system are proved by Lyapunov techniques. The simulation results on a non-linear system and wheeled mobile robot verify the effectiveness of the proposed controller.
引用
收藏
页码:868 / 877
页数:10
相关论文
共 22 条
  • [1] Nearly optimal control laws for nonlinear systems with saturating actuators using a neural network HJB approach
    Abu-Khalaf, M
    Lewis, FL
    [J]. AUTOMATICA, 2005, 41 (05) : 779 - 791
  • [2] [Anonymous], 1999, Neural network control of robot manipulators and nonlinear systems
  • [3] Dual Adaptive Dynamic Control of Mobile Robots Using Neural Networks
    Bugeja, Marvin K.
    Fabri, Simon G.
    Camilleri, Liberato
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2009, 39 (01): : 129 - 141
  • [4] Robust tracking enhancement of robot systems including motor dynamics: A fuzzy-based dynamic game approach
    Chen, BS
    Uang, HJ
    Tseng, CS
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 1998, 6 (04) : 538 - 552
  • [5] Moving Horizon H∞ Tracking Control of Wheeled Mobile Robots With Actuator Saturation
    Chen, Hong
    Ma, Miao-Miao
    Wang, Hu
    Liu, Zhi-Yuan
    Cai, Zi-Xing
    [J]. IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2009, 17 (02) : 449 - 457
  • [6] Tracking Control of Differential-Drive Wheeled Mobile Robots Using a Backstepping-Like Feedback Linearization
    Chwa, Dongkyoung
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2010, 40 (06): : 1285 - 1295
  • [7] Optimal Control of Affine Nonlinear Continuous-time Systems Using an Online Hamilton-Jacobi-Isaacs Formulation
    Dierks, T.
    Jagannathan, S.
    [J]. 49TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2010, : 3048 - 3053
  • [8] Control of a nonholonomic mobile robot using neural networks
    Fierro, R
    Lewis, FL
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1998, 9 (04): : 589 - 600
  • [9] Finlayson B.A., 1990, The method of weighted residuals and variational principles
  • [10] Discrete neural dynamic programming in wheeled mobile robot control
    Hendzel, Zenon
    Szuster, Marcin
    [J]. COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION, 2011, 16 (05): : 2355 - 2362