A novel mobile robot navigation method based on deep reinforcement learning

被引:32
|
作者
Quan, Hao [1 ,2 ]
Li, Yansheng [1 ,2 ]
Zhang, Yi [1 ,2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Res Ctr Intelligent Syst & Robot, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Adv Mfg Engn, Chongqing, Peoples R China
来源
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS | 2020年 / 17卷 / 03期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; robot exploration; recurrent neural network; DDQN;
D O I
10.1177/1729881420921672
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
At present, the application of mobile robots is more and more extensive, and the movement of mobile robots cannot be separated from effective navigation, especially path exploration. Aiming at navigation problems, this article proposes a method based on deep reinforcement learning and recurrent neural network, which combines double net and recurrent neural network modules with reinforcement learning ideas. At the same time, this article designed the corresponding parameter function to improve the performance of the model. In order to test the effectiveness of this method, based on the grid map model, this paper trains in a two-dimensional simulation environment, a three-dimensional TurtleBot simulation environment, and a physical robot environment, and obtains relevant data for peer-to-peer analysis. The experimental results show that the proposed algorithm has a good improvement in path finding efficiency and path length.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Socially Aware Robot Navigation Using Deep Reinforcement Learning
    Truong Xuan Tung
    Trung Dung Ngo
    2018 IEEE CANADIAN CONFERENCE ON ELECTRICAL & COMPUTER ENGINEERING (CCECE), 2018,
  • [22] Crowd-Aware Mobile Robot Navigation Based on Improved Decentralized Structured RNN via Deep Reinforcement Learning
    Zhang, Yulin
    Feng, Zhengyong
    SENSORS, 2023, 23 (04)
  • [23] Path Planning for Mobile Robot Based on Deep Reinforcement Learning and Fuzzy Control
    Liu, Chunling
    Xu, Jun
    Guo, Kaiwen
    2022 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, COMPUTER VISION AND MACHINE LEARNING (ICICML), 2022, : 533 - 537
  • [24] Improving Deep Reinforcement Learning Training Convergence using Fuzzy Logic for Autonomous Mobile Robot Navigation
    Kamarulariffin A.B.
    Ibrahim A.B.M.
    Bahamid A.
    Intl. J. Adv. Comput. Sci. Appl., 2023, 11 (935-942): : 935 - 942
  • [25] Improving Deep Reinforcement Learning Training Convergence using Fuzzy Logic for Autonomous Mobile Robot Navigation
    bin Kamarulariffin, Abdurrahman
    Ibrahim, Azhar bin Mohd
    Bahamid, Alala
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2023, 14 (11) : 935 - 942
  • [26] Mapless Collaborative Navigation for a Multi-Robot System Based on the Deep Reinforcement Learning
    Chen, Wenzhou
    Zhou, Shizheng
    Pan, Zaisheng
    Zheng, Huixian
    Liu, Yong
    APPLIED SCIENCES-BASEL, 2019, 9 (20):
  • [27] Effects of a Social Force Model Reward in Robot Navigation Based on Deep Reinforcement Learning
    Gil, Oscar
    Sanfeliu, Alberto
    FOURTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, ROBOT 2019, VOL 2, 2020, 1093 : 213 - 224
  • [28] Proxemics-based deep reinforcement learning for robot navigation in continuous action space
    Cimurs R.
    Suh I.-H.
    Journal of Institute of Control, Robotics and Systems, 2020, 26 (03) : 168 - 176
  • [29] Self-Learning Robot Autonomous Navigation with Deep Reinforcement Learning Techniques
    Pintos Gomez de las Heras, Borja
    Martinez-Tomas, Rafael
    Cuadra Troncoso, Jose Manuel
    APPLIED SCIENCES-BASEL, 2024, 14 (01):
  • [30] Research on Robot Intelligent Control Method Based on Deep Reinforcement Learning
    Rao, Shu
    2022 6TH INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND INTELLIGENT CONTROL, ISCSIC, 2022, : 221 - 225