Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:127
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 34 条
  • [1] [Anonymous], 2010, ARTIF INTELL
  • [2] Cornish Christopher John, 1989, (Ph.D. thesis
  • [3] Mobile robot Navigation Based on Q-Learning Technique
    Khriji, Lazhar
    Touati, Farid
    Benhmed, Kamel
    Al-Yahmedi, Amur
    [J]. INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2011, 8 (01): : 45 - 51
  • [4] Moving obstacle avoidance of a mobile robot using a single camera
    Kim, Jeongdae
    Do, Yongtae
    [J]. INTERNATIONAL SYMPOSIUM ON ROBOTICS AND INTELLIGENT SENSORS 2012 (IRIS 2012), 2012, 41 : 911 - 916
  • [5] REAL-TIME OBSTACLE AVOIDANCE USING HARMONIC POTENTIAL FUNCTIONS
    KIM, JO
    KHOSLA, PK
    [J]. IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, 1992, 8 (03): : 338 - 349
  • [6] Optimally Overlapped Ultrasonic Sensor Ring Design for Minimal Positional Uncertainty in Obstacle Detection
    Kim, Sungbok
    Kim, Hyunbin
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2010, 8 (06) : 1280 - 1287
  • [7] Navigation among moving obstacles using the NLVO:: Principles and applications to intelligent vehicles
    Large, F
    Laugier, C
    Shiller, Z
    [J]. AUTONOMOUS ROBOTS, 2005, 19 (02) : 159 - 171
  • [8] Leonard J. J., 1991, Proceedings IROS '91. IEEE/RSJ International Workshop on Intelligent Robots and Systems '91. Intelligence for Mechanical Systems (Cat. No.91TH0375-6), P1442, DOI 10.1109/IROS.1991.174711
  • [9] ALGORITHM FOR PLANNING COLLISION-FREE PATHS AMONG POLYHEDRAL OBSTACLES
    LOZANOPEREZ, T
    WESLEY, MA
    [J]. COMMUNICATIONS OF THE ACM, 1979, 22 (10) : 560 - 570
  • [10] AUTOMATIC PROGRAMMING OF BEHAVIOR-BASED ROBOTS USING REINFORCEMENT LEARNING
    MAHADEVAN, S
    CONNELL, J
    [J]. ARTIFICIAL INTELLIGENCE, 1992, 55 (2-3) : 311 - 365