Evolutionary Optimization of Fuzzy Reinforcement Learning and Its Application to Time-Varying Tracking Control of Industrial Parallel Robotic Manipulators

被引:11
作者
Huang, Hsu-Chih [1 ]
Chen, Yu-Xiang [1 ]
机构
[1] Natl Ilan Univ, Dept Elect Engn, Yilan 260, Taiwan
关键词
Optimization; Manipulators; Robots; Real-time systems; Q-learning; Service robots; Kinematics; Evolutionary optimization; fuzzy reinforcement learning; parallel manipulator; social spider optimization (SSO); STEWART PLATFORM; SOCIAL-SPIDER; ALGORITHM;
D O I
10.1109/TII.2023.3248120
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we contribute to the development of evolutionary optimization of fuzzy reinforcement learning and its application to time-varying tracking control for industrial parallel robotic manipulators. An improved evolutionary social spider optimization (SSO) paradigm with Cauchy mutation is presented to address the optimal fuzzy reinforcement learning problem. The SSO swarm intelligence incorporated with the fuzzy Q-learning strategy, called SSOFQ, is applied to the time-varying tracking control of parallel robotic Stewart manipulators with six degrees of freedom (DOFs). Having the derived kinematics and dynamics of six-DOF Stewart platforms, the SSOFQ is employed to synthesize an intelligent real-time tracking control scheme. More importantly, a custom experimental Stewart platform is constructed using hardware/software codesign and the system-on-a-programmable chip technique. Finally, the simulations, experimental results, and comparative works are provided to validate the efficacy and superiority of the presented SSOFQ control method.
引用
收藏
页码:11712 / 11720
页数:9
相关论文
共 30 条
[1]   New Geometric Approaches to the Analysis and Design of Stewart-Gough Platforms [J].
Borras, Julia ;
Thomas, Federico ;
Torras, Carme .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2014, 19 (02) :445-455
[2]   Comparative Study of Serial-Parallel Delta Robots With Full Orientation Capabilities [J].
Brinker, Jan ;
Funk, Nils ;
Ingenlath, Philipp ;
Takeda, Yukio ;
Corves, Burkhard .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (02) :920-926
[3]   Model Analysis and Modified Control Method of Ship-Mounted Stewart Platforms for Wave Compensation [J].
Cai, Yunfei ;
Zheng, Shutao ;
Liu, Weitian ;
Qu, Zhiyong ;
Han, Junwei .
IEEE ACCESS, 2021, 9 :4505-4517
[4]   A new algorithm inspired in the behavior of the social-spider for constrained optimization [J].
Cuevas, Erik ;
Cienfuegos, Miguel .
EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (02) :412-425
[5]   Kinematics of the Gough-Stewart Platform by Means of the Newton-Homotopy Method [J].
Gallardo, J. ;
Alcaraz, L. .
IEEE LATIN AMERICA TRANSACTIONS, 2018, 16 (12) :2850-2856
[6]   Enhancing Nash Q-learning and Team Q-learning mechanisms by using bottlenecks [J].
Ghazanfari, Behzad ;
Mozayani, Nasser .
JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2014, 26 (06) :2771-2783
[7]   Analysis and Design of the Stewart Platform-Based Parallel Support Bumper for Inertially Stabilized Platforms [J].
He, Qianen ;
Zeng, Congjie ;
Gao, Zhongyu ;
Wu, Zhicong .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (05) :4203-4215
[8]   Particle swarm optimization for generating interpretable fuzzy reinforcement learning policies [J].
Hein, Daniel ;
Hentschel, Alexander ;
Runkler, Thomas ;
Udluft, Steffen .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2017, 65 :87-98
[9]   Enhanced Social Spider Optimization Algorithm for Increasing Performance of Multiple Pursuer Drones in Neutralizing Attacks From Multiple Evader Drones [J].
Husodo, Ario Yudo ;
Jati, Grafika ;
Octavian, Amarulla ;
Jatmiko, Wisnu .
IEEE ACCESS, 2020, 8 :22145-22161
[10]   Ant Colony Optimization Incorporated With Fuzzy Q-Learning for Reinforcement Fuzzy Control [J].
Juang, Chia-Feng ;
Lu, Chun-Ming .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2009, 39 (03) :597-608