A novel mobile robot navigation method based on deep reinforcement learning

被引:32
|
作者
Quan, Hao [1 ,2 ]
Li, Yansheng [1 ,2 ]
Zhang, Yi [1 ,2 ]
机构
[1] Chongqing Univ Posts & Telecommun, Res Ctr Intelligent Syst & Robot, Chongqing 400065, Peoples R China
[2] Chongqing Univ Posts & Telecommun, Sch Adv Mfg Engn, Chongqing, Peoples R China
来源
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS | 2020年 / 17卷 / 03期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; robot exploration; recurrent neural network; DDQN;
D O I
10.1177/1729881420921672
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
At present, the application of mobile robots is more and more extensive, and the movement of mobile robots cannot be separated from effective navigation, especially path exploration. Aiming at navigation problems, this article proposes a method based on deep reinforcement learning and recurrent neural network, which combines double net and recurrent neural network modules with reinforcement learning ideas. At the same time, this article designed the corresponding parameter function to improve the performance of the model. In order to test the effectiveness of this method, based on the grid map model, this paper trains in a two-dimensional simulation environment, a three-dimensional TurtleBot simulation environment, and a physical robot environment, and obtains relevant data for peer-to-peer analysis. The experimental results show that the proposed algorithm has a good improvement in path finding efficiency and path length.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Application of Deep Reinforcement Learning in Mobile Robot Path Planning
    Xin, Jing
    Zhao, Huan
    Liu, Ding
    Li, Minqi
    2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, : 7112 - 7116
  • [32] Deep Reinforcement Learning for Indoor Mobile Robot Path Planning
    Gao, Junli
    Ye, Weijie
    Guo, Jing
    Li, Zhongjuan
    SENSORS, 2020, 20 (19) : 1 - 15
  • [33] MOBILE ROBOT OBSTACLE AVOIDANCE BASE ON DEEP REINFORCEMENT LEARNING
    Feng, Shumin
    Ren, Hailin
    Wang, Xinran
    Ben-Tzvi, Pinhas
    PROCEEDINGS OF THE ASME INTERNATIONAL DESIGN ENGINEERING TECHNICAL CONFERENCES AND COMPUTERS AND INFORMATION IN ENGINEERING CONFERENCE, 2019, VOL 5A, 2020,
  • [34] Risk-Aware Deep Reinforcement Learning for Robot Crowd Navigation
    Sun, Xueying
    Zhang, Qiang
    Wei, Yifei
    Liu, Mingmin
    ELECTRONICS, 2023, 12 (23)
  • [35] Target Search and Navigation in Heterogeneous Robot Systems with Deep Reinforcement Learning
    Chen, Yun
    Xiao, Jiaping
    MACHINE INTELLIGENCE RESEARCH, 2025, 22 (01) : 79 - 90
  • [36] Robot navigation in a crowd by integrating deep reinforcement learning and online planning
    Zhiqian Zhou
    Pengming Zhu
    Zhiwen Zeng
    Junhao Xiao
    Huimin Lu
    Zongtan Zhou
    Applied Intelligence, 2022, 52 : 15600 - 15616
  • [37] Modular deep reinforcement learning from reward and punishment for robot navigation
    Wang, Jiexin
    Elfwing, Stefan
    Uchibe, Eiji
    NEURAL NETWORKS, 2021, 135 : 115 - 126
  • [38] Robot navigation in a crowd by integrating deep reinforcement learning and online planning
    Zhou, Zhiqian
    Zhu, Pengming
    Zeng, Zhiwen
    Xiao, Junhao
    Lu, Huimin
    Zhou, Zongtan
    APPLIED INTELLIGENCE, 2022, 52 (13) : 15600 - 15616
  • [39] COMMON-SENSICAL INCENTIVE REWARD IN DEEP ACTOR-CRITIC REINFORCEMENT LEARNING FOR MOBILE ROBOT NAVIGATION
    Sendari, Siti
    Muladi
    Ardiyansyah, Firman
    Setumin, Samsul
    Mokhtar, Norrima Binti
    Lin, Hsien-, I
    Hartono, Pitoyo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2024, 20 (02): : 373 - 389
  • [40] Deep Reinforcement Learning Based Efficient and Robust Navigation Method For Autonomous Applications
    Hemming, Nathan
    Menon, Vineetha
    2023 IEEE 35TH INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, ICTAI, 2023, : 287 - 293