Neural networks based reinforcement learning for mobile robots obstacle avoidance

被引:127
|
作者
Duguleana, Mihai [1 ]
Mogan, Gheorghe [1 ]
机构
[1] Univ Transilvania Brasov, Fac Mech Engn, Dept Automot & Transport Engn, Str Univ 1, Brasov 500036, Romania
关键词
Obstacle avoidance; Neural networks; Q-learning; Virtual reality; MOVING OBSTACLES; NAVIGATION; ENVIRONMENTS;
D O I
10.1016/j.eswa.2016.06.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study proposes a new approach for solving the problem of autonomous movement of robots in environments that contain both static and dynamic obstacles. The purpose of this research is to provide mobile robots a collision-free trajectory within an uncertain workspace which contains both stationary and moving entities. The developed solution uses Q-learning and a neural network planner to solve path planning problems. The algorithm presented proves to be effective in navigation scenarios where global information is available. The speed of the robot can be set prior to the computation of the trajectory, which provides a great advantage in time-constrained applications. The solution is deployed in both Virtual Reality (VR) for easier visualization and safer testing activities, and on a real mobile robot for experimental validation. The algorithm is compared with Powerbot's ARNL proprietary navigation algorithm. Results show that the proposed solution has a good conversion rate computed at a satisfying speed. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:104 / 115
页数:12
相关论文
共 50 条
  • [41] Path Planning of Mobile Robot in Dynamic Obstacle Avoidance Environment Based on Deep Reinforcement Learning
    Zhang, Qingfeng
    Ma, Wenpeng
    Zheng, Qingchun
    Zhai, Xiaofan
    Zhang, Wenqian
    Zhang, Tianchang
    Wang, Shuo
    IEEE ACCESS, 2024, 12 : 189136 - 189152
  • [42] Performance Comparison of Relational Reinforcement Learning and RBF Neural Networks for Small Mobile Robots
    Neruda, Roman
    Slusny, Stanislav
    Vidnerova, Petra
    2008 SECOND INTERNATIONAL CONFERENCE ON FUTURE GENERATION COMMUNICATION AND NETWORKING SYMPOSIA, VOLS 1-5, PROCEEDINGS, 2008, : 429 - 432
  • [43] Obstacle avoidance for mobile robots: a Hybrid Intelligent System based on Fuzzy Logic and Artificial Neural Network
    Alves, Raulcezar M. F.
    Lopes, Carlos R.
    2016 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2016, : 1038 - 1043
  • [44] Sliding mode based obstacle avoidance and target tracking for mobile robots
    Yannier, S
    Sabanovic, A
    Onat, A
    Bastan, A
    ISIE 2005: PROCEEDINGS OF THE IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS 2005, VOLS 1- 4, 2005, : 1489 - 1493
  • [45] NEURAL NETWORKS FOR COLLISION AVOIDANCE BETWEEN AUTONOMOUS MOBILE ROBOTS
    TUIJNMAN, F
    KROSE, BJA
    INTELLIGENT AUTONOMOUS SYSTEMS 2, VOLS 1 AND 2, 1989, : 407 - 416
  • [46] Environmental modeling and obstacle avoidance of mobile robots based on laser radar
    Yang, Ming, 2000, Press of Tsinghua University, China (40):
  • [47] Obstacle Avoidance Based on Optical Flow for Mobile Robots in Unknown Environment
    Dai, Bixia
    Li, Wei
    2014 SEVENTH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID 2014), VOL 2, 2014, : 599 - 602
  • [48] Fuzzy neural networks for obstacle pattern recognition and collision avoidance of fish robots
    Shin, Daejung
    Na, Seung You
    Kim, Jin Young
    Baek, Seong-Joon
    SOFT COMPUTING, 2008, 12 (07) : 715 - 720
  • [49] Fuzzy neural networks for obstacle pattern recognition and collision avoidance of fish robots
    Daejung Shin
    Seung You Na
    Jin Young Kim
    Seong-Joon Baek
    Soft Computing, 2008, 12 : 715 - 720
  • [50] Reinforcement Learning for Mobile Robot Obstacle Avoidance with Deep Deterministic Policy Gradient
    Chen, Miao
    Li, Wenna
    Fei, Shihan
    Wei, Yufei
    Tu, Mingyang
    Li, Jiangbo
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT III, 2022, 13457 : 197 - 204