Position control of a planar cable-driven parallel robot using reinforcement learning

被引:13
作者
Sancak, Caner [1 ]
Yamac, Fatma [2 ]
Itik, Mehmet [3 ]
机构
[1] Karadeniz Tech Univ, Dept Mech Engn, Trabzon, Turkey
[2] Tarsus Univ, Dept Mech Engn, Mersin, Turkey
[3] Izmir Democracy Univ, Dept Mech Engn, Izmir, Turkey
关键词
cable-driven parallel robot; reinforcement learning; position control; torque distribution; MIMO system; DISTRIBUTION ALGORITHM;
D O I
10.1017/S0263574722000273
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study proposes a method based on reinforcement learning (RL) for point-to-point and dynamic reference position tracking control of a planar cable-driven parallel robots, which is a multi-input multi-output system (MIMO). The method eliminates the use of a tension distribution algorithm in controlling the system's dynamics and inherently optimizes the cable tensions based on the reward function during the learning process. The deep deterministic policy gradient algorithm is utilized for training the RL agents in point-to-point and dynamic reference tracking tasks. The performances of the two agents are tested on their specifically trained tasks. Moreover, we also implement the agent trained for point-to-point tasks on the dynamic reference tracking and vice versa. The performances of the RL agents are compared with a classical PD controller. The results show that RL can perform quite well without the requirement of designing different controllers for each task if the system's dynamics is learned well.
引用
收藏
页码:3378 / 3395
页数:18
相关论文
共 34 条
[1]   Reinforcement Learning Approaches in Social Robotics [J].
Akalin, Neziha ;
Loutfi, Amy .
SENSORS, 2021, 21 (04) :1-37
[2]  
Bak JH, 2016, INT C CONTR AUTOMAT, P1057, DOI 10.1109/ICCAS.2016.7832440
[3]   An experimental study on the vision-based control and identification of planar cable-driven parallel robots [J].
Bayani, Hassan ;
Masouleh, Mehdi Tale ;
Kalhor, Ahmad .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2016, 75 :187-202
[4]   Stability Analysis of Underconstrained Cable-Driven Parallel Robots [J].
Carricato, Marco ;
Merlet, Jean-Pierre .
IEEE TRANSACTIONS ON ROBOTICS, 2013, 29 (01) :288-296
[5]   Vibration analysis of cable-driven parallel manipulators [J].
Diao, Xiumin ;
Ma, Ou .
MULTIBODY SYSTEM DYNAMICS, 2009, 21 (04) :347-360
[6]  
Fujimoto S, 2018, PR MACH LEARN RES, V80
[7]  
Ghasemi A., 2011, MODERN MECH ENG, V1, P69
[8]   A Versatile Tension Distribution Algorithm for n-DOF Parallel Robots Driven by n+2 Cables [J].
Gouttefarde, Marc ;
Lamaury, Johann ;
Reichert, Christopher ;
Bruckmann, Tobias .
IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (06) :1444-1457
[9]   Applying Deep Reinforcement Learning to Cable Driven Parallel Robots for Balancing Unstable Loads: A Ball Case Study [J].
Grimshaw, Alex ;
Oyekan, John .
FRONTIERS IN ROBOTICS AND AI, 2021, 7
[10]   Robust PID control of fully-constrained cable driven parallel robots [J].
Khosravi, Mohammad A. ;
Taghirad, Hamid D. .
MECHATRONICS, 2014, 24 (02) :87-97