Adaptive predictive control of a differential drive robot tuned with reinforcement learning

被引:18
|
作者
Jardine, P. Travis [1 ]
Kogan, Michael [2 ]
Givigi, Sidney N. [2 ]
Yousefi, Shahram [1 ]
机构
[1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Royal Mil Coll Canada, Dept Elect & Comp Engn, Kingston, ON, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
feedback linearization; machine learning; model predictive control; reinforcement learning;
D O I
10.1002/acs.2882
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
One of the most important steps in designing a model predictive control strategy is selecting appropriate parameters for the relative weights of the objective function. Typically, these are selected through trial and error to meet the desired performance. In this paper, a reinforcement learning technique called learning automata is used to select appropriate parameters for the controller of a differential drive robot through a simulation process. Results of the simulation show that the parameters always converge, although to different values. A controller chosen by the learning process is then ported to a real platform. The selected controller is shown to control the robot better than a standard model predictive control.
引用
收藏
页码:410 / 423
页数:14
相关论文
共 50 条
  • [21] Adaptive parameterized model predictive control based on reinforcement learning: A synthesis framework
    Sun, Dingshan
    Jamshidnejad, Anahita
    De Schutter, Bart
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 136
  • [22] Trajectory Tracking based on Adaptive Weights Receding Horizon Control by Differential Drive Robot
    Verma, Samidha Mridul
    Ravichandran, Rahul
    Singhal, Rahul
    Kumar, Rajesh
    2020 59TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2020, : 1343 - 1348
  • [23] Residual Reinforcement Learning for Robot Control
    Johannink, Tobias
    Bahl, Shikhar
    Nair, Ashvin
    Luo, Jianlan
    Kumar, Avinash
    Loskyll, Matthias
    Ojea, Juan Aparicio
    Solowjow, Eugen
    Levine, Sergey
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 6023 - 6029
  • [24] Reinforcement Learning Control of an Aerial Robot Based on a Tuned Proximal Policy Optimization in Takeoff and Hover Phases
    Esfandiari, Mohamadamin
    Atashgah, M. A. Amiri
    2022 10TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2022, : 165 - 171
  • [25] Adaptive Reinforcement Learning and Its Application to Robot Compliance Learning
    Department of Mechanical Engineering, Massachusetts Institute of Technology, 77 Massachusetts Ave, Cambridge
    MA
    02139, United States
    J. Rob. Mechatronics, 3 (250-262):
  • [26] Adaptive Locomotion Control of Sixteen-legged Robot based on Deep Reinforcement Learning
    Mu, Xixi
    Shao, Shibo
    Zhang, Dong
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, : 992 - 997
  • [27] ADAPTIVE AND PREDICTIVE CONTROL OF A SIMULATED ROBOT ARM
    Tolu, Silvia
    Vanegas, Mauricio
    Garrido, Jesus A.
    Luque, Niceto R.
    Ros, Eduardo
    INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2013, 23 (03)
  • [28] An adaptive cooperation with reinforcement learning for robot soccer games
    Hu, Chunyang
    Xu, Meng
    Hwang, Kao-Shing
    INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2020, 17 (03)
  • [29] Adaptive Risk Sensitive Path Integral for Model Predictive Control via Reinforcement Learning
    Yoon, Hyung-Jin
    Tao, Chuyuan
    Kim, Hunmin
    Hovakimyan, Naira
    Voulgaris, Petros
    2023 31ST MEDITERRANEAN CONFERENCE ON CONTROL AND AUTOMATION, MED, 2023, : 926 - 931
  • [30] Reinforcement learning of adaptive control strategies
    Leslie K. Held
    Luc Vermeylen
    David Dignath
    Wim Notebaert
    Ruth M. Krebs
    Senne Braem
    Communications Psychology, 2 (1):