NAO robot obstacle avoidance based on fuzzy Q-learning

被引:4
作者
Wen, Shuhuan [1 ]
Hu, Xueheng [2 ]
Li, Zhen [2 ]
Lam, Hak Keung [3 ]
Sun, Fuchun [4 ]
Fang, Bin [4 ]
机构
[1] Yanshan Univ, Key Lab Ind Comp Control Engn Hebei Prov, Qinhuangdao, Hebei, Peoples R China
[2] Yanshan Univ, Qinhuangdao, Hebei, Peoples R China
[3] Kings Coll London, London, England
[4] Tsinghua Univ, Beijing, Peoples R China
来源
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION | 2020年 / 47卷 / 06期
关键词
Navigation; Motors; Fuzzy logic control; Obstacle avoidance; Pneumatics; FASTSLAM; Fractional order PI; Industrial robotics; Q-learning; OPTIMIZATION; STRATEGY; FIELD;
D O I
10.1108/IR-01-2019-0002
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Purpose - This paper aims to propose a novel active SLAM framework to realize avoid obstacles and finish the autonomous navigation in indoor environment. Design/methodology/approach - The improved fuzzy optimized Q-Learning (FOQL) algorithm is used to solve the avoidance obstacles problem of the robot in the environment. To reduce the motion deviation of the robot, fractional controller is designed. The localization of the robot is based on FastSLAM algorithm. Findings - Simulation results of avoiding obstacles using traditional Q-learning algorithm, optimized Q-learning algorithm and FOQL algorithm are compared. The simulation results show that the improved FOQL algorithm has a faster learning speed than other two algorithms. To verify the simulation result, the FOQL algorithm is implemented on a NAO robot and the experimental results demonstrate that the improved fuzzy optimized Q-Learning obstacle avoidance algorithm is feasible and effective. Originality/value - The improved fuzzy optimized Q-Learning (FOQL) algorithm is used to solve the avoidance obstacles problem of the robot in the environment. To reduce the motion deviation of the robot, fractional controller is designed. To verify the simulation result, the FOQL algorithm is implemented on a NAO robot and the experimental results demonstrate that the improved fuzzy optimized Q-Learning obstacle avoidance algorithm is feasible and effective.
引用
收藏
页码:801 / 811
页数:11
相关论文
共 34 条
[1]   Multi-penalty regularization in learning theory [J].
Abhishake ;
Sivananthan, S. .
JOURNAL OF COMPLEXITY, 2016, 36 :141-165
[2]   THE VECTOR FIELD HISTOGRAM - FAST OBSTACLE AVOIDANCE FOR MOBILE ROBOTS [J].
BORENSTEIN, J ;
KOREN, Y .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1991, 7 (03) :278-288
[3]  
Chang Deng, 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904), P1568
[4]   Autonomous Visual Navigation and Laser-Based Moving Obstacle Avoidance [J].
Cherubini, Andrea ;
Spindler, Fabien ;
Chaumette, Francois .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2014, 15 (05) :2101-2110
[5]   Signage System for the Navigation of Autonomous Robots in Indoor Environments [J].
Corrales Paredes, Ana ;
Malfaz, Maria ;
Salichs, Miguel A. .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2014, 10 (01) :680-688
[6]   An MDP Model-Based Reinforcement Learning Approach for Production Station Ramp-Up Optimization: Q-Learning Analysis [J].
Doltsinis, Stefanos ;
Ferreira, Pedro ;
Lohse, Niels .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2014, 44 (09) :1125-1138
[7]   An obstacle avoidance model predictive control scheme for mobile robots subject to nonholonomic constraints: A sum-of-squares approach [J].
Franze, G. ;
Lucia, W. .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2015, 352 (06) :2358-2380
[8]   Distributed Q-Learning for Aggregated Interference Control in Cognitive Radio Networks [J].
Galindo-Serrano, Ana ;
Giupponi, Lorenza .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2010, 59 (04) :1823-1834
[9]  
Germanos Vasileios, 2016, 2016 19th IEEE International Conference on Computational Science and Engineering (CSE), IEEE 14th International Conference on Embedded and Ubiquitous Computing (EUC), and 15th International Symposium on Distributed Computing and Applications for Business Engineering (DCABES). Proceedings, P177, DOI 10.1109/CSE-EUC-DCABES.2016.181
[10]   Q-LEARNING WITH CENSORED DATA [J].
Goldberg, Yair ;
Kosorok, Michael R. .
ANNALS OF STATISTICS, 2012, 40 (01) :529-560