Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:137
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 34 条
[1]  
[Anonymous], 2010, ARTIF INTELL
[2]  
Cornish Christopher John, 1989, (Ph.D. thesis
[3]   Mobile robot Navigation Based on Q-Learning Technique [J].
Khriji, Lazhar ;
Touati, Farid ;
Benhmed, Kamel ;
Al-Yahmedi, Amur .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2011, 8 (01) :45-51
[4]   Moving obstacle avoidance of a mobile robot using a single camera [J].
Kim, Jeongdae ;
Do, Yongtae .
INTERNATIONAL SYMPOSIUM ON ROBOTICS AND INTELLIGENT SENSORS 2012 (IRIS 2012), 2012, 41 :911-916
[5]   REAL-TIME OBSTACLE AVOIDANCE USING HARMONIC POTENTIAL FUNCTIONS [J].
KIM, JO ;
KHOSLA, PK .
IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1992, 8 (03) :338-349
[6]   Optimally Overlapped Ultrasonic Sensor Ring Design for Minimal Positional Uncertainty in Obstacle Detection [J].
Kim, Sungbok ;
Kim, Hyunbin .
INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2010, 8 (06) :1280-1287
[7]   Navigation among moving obstacles using the NLVO:: Principles and applications to intelligent vehicles [J].
Large, F ;
Laugier, C ;
Shiller, Z .
AUTONOMOUS ROBOTS, 2005, 19 (02) :159-171
[8]  
Leonard J. J., 1991, Proceedings IROS '91. IEEE/RSJ International Workshop on Intelligent Robots and Systems '91. Intelligence for Mechanical Systems (Cat. No.91TH0375-6), P1442, DOI 10.1109/IROS.1991.174711
[9]   ALGORITHM FOR PLANNING COLLISION-FREE PATHS AMONG POLYHEDRAL OBSTACLES [J].
LOZANOPEREZ, T ;
WESLEY, MA .
COMMUNICATIONS OF THE ACM, 1979, 22 (10) :560-570
[10]   AUTOMATIC PROGRAMMING OF BEHAVIOR-BASED ROBOTS USING REINFORCEMENT LEARNING [J].
MAHADEVAN, S ;
CONNELL, J .
ARTIFICIAL INTELLIGENCE, 1992, 55 (2-3) :311-365