Adaptive predictive control of a differential drive robot tuned with reinforcement learning

被引:18
|
作者
Jardine, P. Travis [1 ]
Kogan, Michael [2 ]
Givigi, Sidney N. [2 ]
Yousefi, Shahram [1 ]
机构
[1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Royal Mil Coll Canada, Dept Elect & Comp Engn, Kingston, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
feedback linearization; machine learning; model predictive control; reinforcement learning;
D O I
10.1002/acs.2882
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the most important steps in designing a model predictive control strategy is selecting appropriate parameters for the relative weights of the objective function. Typically, these are selected through trial and error to meet the desired performance. In this paper, a reinforcement learning technique called learning automata is used to select appropriate parameters for the controller of a differential drive robot through a simulation process. Results of the simulation show that the parameters always converge, although to different values. A controller chosen by the learning process is then ported to a real platform. The selected controller is shown to control the robot better than a standard model predictive control.
引用
收藏
页码:410 / 423
页数:14
相关论文
共 50 条
  • [31] Reinforcement Learning Adaptive Control for Upper Limb Rehabilitation Robot Based on Fuzzy Neural Network
    Meng Fan-cheng
    Dai Ya-ping
    PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE, 2012, : 5157 - 5161
  • [32] Adaptive Admittance Control for Physical Human-Robot Interaction based on Imitation and Reinforcement Learning
    Guo, Mou
    Yao, Bitao
    Ji, Zhenrui
    Xu, Wenjun
    Zhou, Zude
    2023 29TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MACHINE VISION IN PRACTICE, M2VIP 2023, 2023,
  • [33] Optimization of the Model Predictive Control Update Interval Using Reinforcement Learning
    Bohn, Eivind
    Gros, Sebastien
    Moe, Signe
    Johansen, Tor Arne
    IFAC PAPERSONLINE, 2021, 54 (14): : 257 - 262
  • [34] Building Energy Management With Reinforcement Learning and Model Predictive Control: A Survey
    Zhang, Huiliang
    Seal, Sayani
    Wu, Di
    Bouffard, Francois
    Boulet, Benoit
    IEEE ACCESS, 2022, 10 : 27853 - 27862
  • [35] Reinforcement Learning-tuned Active Disturbance Rejection Controller for Tracking Control of a 4-DoF Robot Manipulator
    Yousef, Hanna
    Siddique, Tanjulee
    Fareh, Raouf
    Choutri, Kheireddine
    Dylov, Dmitry
    Khadraoui, Sofiane
    2024 12TH INTERNATIONAL CONFERENCE ON CONTROL, MECHATRONICS AND AUTOMATION, ICCMA, 2024, : 125 - 130
  • [36] Comparison of Reinforcement Learning and Model Predictive Control for a Nonlinear Continuous Process
    Rajpoot, Vikas
    Munusamy, Sudhakar
    Joshi, Tanuja
    Patil, Dinesh
    Pinnamaraju, Vivek
    IFAC PAPERSONLINE, 2024, 57 : 304 - 308
  • [37] Adaptive Modular Reinforcement Learning for Robot Controlled in Multiple Environments
    Iwata, Teppei
    Shibuya, Takeshi
    IEEE ACCESS, 2021, 9 : 103032 - 103043
  • [38] A Reinforcement Learning Adaptive Fuzzy Controller for Differential Games
    Sidney N. Givigi
    Howard M. Schwartz
    Xiaosong Lu
    Journal of Intelligent and Robotic Systems, 2010, 59 : 3 - 30
  • [39] A Reinforcement Learning Adaptive Fuzzy Controller for Differential Games
    Givigi, Sidney N., Jr.
    Schwartz, Howard M.
    Lu, Xiaosong
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2010, 59 (01) : 3 - 30
  • [40] An experimental study of two predictive reinforcement learning methods and comparison with model-predictive control
    Dobriborsci, Dmitrii
    Osinenko, Pavel
    Aumer, Wolfgang
    IFAC PAPERSONLINE, 2022, 55 (10): : 1545 - 1550