Adaptive predictive control of a differential drive robot tuned with reinforcement learning

被引:18
|
作者
Jardine, P. Travis [1 ]
Kogan, Michael [2 ]
Givigi, Sidney N. [2 ]
Yousefi, Shahram [1 ]
机构
[1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Royal Mil Coll Canada, Dept Elect & Comp Engn, Kingston, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
feedback linearization; machine learning; model predictive control; reinforcement learning;
D O I
10.1002/acs.2882
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the most important steps in designing a model predictive control strategy is selecting appropriate parameters for the relative weights of the objective function. Typically, these are selected through trial and error to meet the desired performance. In this paper, a reinforcement learning technique called learning automata is used to select appropriate parameters for the controller of a differential drive robot through a simulation process. Results of the simulation show that the parameters always converge, although to different values. A controller chosen by the learning process is then ported to a real platform. The selected controller is shown to control the robot better than a standard model predictive control.
引用
收藏
页码:410 / 423
页数:14
相关论文
共 50 条
  • [31] Adaptive Control and Intersections with Reinforcement Learning
    Annaswamy, Anuradha M.
    ANNUAL REVIEW OF CONTROL ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 6 : 65 - 93
  • [32] Tumbling Robot Control Using Reinforcement Learning: An Adaptive Control Policy That Transfers Well to the Real World
    Schwartzwald, Andrew
    Tlachac, Matthew
    Guzman, Luis
    Bacharis, Athanasios
    Papanikolopoulos, Nikolaos
    IEEE ROBOTICS & AUTOMATION MAGAZINE, 2023, 30 (02) : 86 - 95
  • [33] Nonlinear Model Predictive Control and Reinforcement Learning for Capsule-Type Robot with an Opposing Spring
    Nunuparov, Armen
    Syrykh, Nikita
    SYNERGETIC COOPERATION BETWEEN ROBOTS AND HUMANS, VOL 2, CLAWAR 2023, 2024, 811 : 136 - 146
  • [34] A Reinforcement Learning Approach for Continuum Robot Control
    Turhan Can Kargin
    Jakub Kołota
    Journal of Intelligent & Robotic Systems, 2023, 109
  • [35] Application of reinforcement learning to dexterous robot control
    Bucak, IO
    Zohdy, MA
    PROCEEDINGS OF THE 1998 AMERICAN CONTROL CONFERENCE, VOLS 1-6, 1998, : 1405 - 1409
  • [36] Reinforcement Learning based Control of a Quadruped Robot
    Ancy, A.
    Jisha, V. R.
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [37] Adaptive control for a class of direct drive robot manipulators
    Bridges, MM
    Dawson, DM
    Hu, J
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 1996, 10 (4-5) : 417 - 441
  • [38] Robot Control Optimization Using Reinforcement Learning
    Kai-Tai Song
    Wen-Yu Sun
    Journal of Intelligent and Robotic Systems, 1998, 21 : 221 - 238
  • [39] Robot control optimization using reinforcement learning
    Natl Chiao Tung Univ, Hsinchu, Taiwan
    J Intell Rob Syst Theor Appl, 3 (221-238):
  • [40] Humanoid robot control based on reinforcement learning
    Iida, S
    Kuwayama, K
    Kanoh, M
    Kato, S
    Kunitachi, T
    Itoh, H
    PROCEEDINGS OF THE 2004 INTERNATIONAL SYMPOSIUM ON MICRO-NANOMECHATRONICS AND HUMAN SCIENCE, 2004, : 353 - 358