A Fuzzy Reinforcement Learning Approach for Continuum Robot Control

被引:44
作者
Goharimanesh, M. [1 ]
Mehrkish, A. [2 ]
Janabi-Sharifi, F. [2 ]
机构
[1] Univ Torbat Heydarieh, Dept Mech Engn, Torbat Heydarieh, Iran
[2] Ryerson Univ, Dept Mech & Ind Engn, 350 Victoria St, Toronto, ON M5B 2K3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Continuum robot; Fuzzy control; Reinforcement learning; Evolutionary algorithms; Taguchi method; MOTION CONTROL; MODEL; MANIPULATORS;
D O I
10.1007/s10846-020-01237-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Continuum robots (CRs) hold great potential for many medical and industrial applications where compliant interaction within the potentially confined environment is required. However, the navigation of CRs poses several challenges due to their limited actuation channels and the hyper-flexibility of their structure. Environmental uncertainty and characteristic hysteresis in such procedures add to the complexity of their operation. Therefore, the quality of trajectory tracking for continuum robots plays an essential role in the success of the application procedures. While there are a few different actuation configurations available for CRs, the focus of this paper will be placed on tendon-driven manipulators. In this research, a new fuzzy reinforcement learning (FRL) approach is introduced. The proposed FRL-based control parameters are tuned by the Taguchi method and evolutionary genetic algorithm (GA) to provide faster convergence to the Nash Equilibrium. The approach is verified through a comprehensive set of simulations using a Cosserat rod model. The results show a steady and accurate trajectory tracking capability for a CR.
引用
收藏
页码:809 / 826
页数:18
相关论文
共 57 条
[1]  
Akbas A, 2014, P INT C COMM, P1
[2]  
Akchurina N., 2009, P 8 INT C AUTONOMOUS, V2, P725
[3]  
AL-Saedi MI, 2013, J AUTOM CON ENG, V1, P213
[4]  
[Anonymous], 2015, Reinforcement Learning: An Introduction
[5]  
[Anonymous], J MACH LEARN RES, DOI DOI 10.1162/1532443041827880
[6]  
Baek D, 2018, INT CONF UBIQ ROBOT, P342, DOI 10.1109/URAI.2018.8441801
[7]  
Boushaki MN, 2014, IEEE INT CONF ROBOT, P5877, DOI 10.1109/ICRA.2014.6907724
[8]   Neural network grasping controller for continuum robots [J].
Braganza, D. ;
Dawson, D. M. ;
Walker, I. D. ;
Nath, N. .
PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, :6445-6449
[9]   A comprehensive survey of multiagent reinforcement learning [J].
Busoniu, Lucian ;
Babuska, Robert ;
De Schutter, Bart .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2008, 38 (02) :156-172
[10]   Configuration Tracking for Continuum Manipulators With Coupled Tendon Drive [J].
Camarillo, David B. ;
Carlson, Christopher R. ;
Salisbury, J. Kenneth .
IEEE TRANSACTIONS ON ROBOTICS, 2009, 25 (04) :798-808