Arena-Rosnav: Towards Deployment of Deep-Reinforcement-Learning-Based Obstacle Avoidance into Conventional Autonomous Navigation Systems

被引:19
|
作者
Kaestner, Linh [1 ]
Buiyan, Teham [1 ]
Jiao, Lei [1 ]
Tuan Anh Le [1 ]
Zhao, Xinlin [1 ]
Shen, Zhengcheng [1 ]
Lambrecht, Jens [1 ]
机构
[1] Berlin Inst Technol, Fac Elect Engn & Comp Sci, Chair Ind Grade Networks & Clouds, Berlin, Germany
来源
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) | 2021年
关键词
ROBOT NAVIGATION; SAFETY;
D O I
10.1109/IROS51168.2021.9636226
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and promises more efficient and flexible navigation. However, deep reinforcement learning approaches are not suitable for long-range navigation due to their proneness to local minima and lack of long term memory, which hinders its widespread integration into industrial applications of mobile robotics. In this paper, we propose a navigation system incorporating deep-reinforcement-learning-based local planners into conventional navigation stacks for long-range navigation. Therefore, a framework for training and testing the deep reinforcement learning algorithms along with classic approaches is presented. We evaluated our deep-reinforcement-learning-enhanced navigation system against various conventional planners and found that our system outperforms them in terms of safety, efficiency and robustness.
引用
收藏
页码:6456 / 6463
页数:8
相关论文
共 50 条
  • [1] Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments
    Fei WANG
    Xiaoping ZHU
    Zhou ZHOU
    Yang TANG
    Chinese Journal of Aeronautics, 2024, 37 (03) : 237 - 257
  • [2] Deep-reinforcement-learning-based UAV autonomous navigation and collision avoidance in unknown environments
    Wang, Fei
    Zhu, Xiaoping
    Zhou, Zhou
    Tang, Yang
    CHINESE JOURNAL OF AERONAUTICS, 2024, 37 (03) : 237 - 257
  • [3] Connecting Deep-Reinforcement-Learning-based Obstacle Avoidance with Conventional Global Planners using Waypoint Generators
    Kaestner, Linh
    Zhao, Xinlin
    Buiyan, Teham
    Li, Junhui
    Shen, Zhengcheng
    Lambrecht, Jens
    Marx, Cornelius
    2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, : 1213 - 1220
  • [4] Deep-Reinforcement-Learning-Based Autonomous UAV Navigation With Sparse Rewards
    Wang, Chao
    Wang, Jian
    Wang, Jingjing
    Zhang, Xudong
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (07): : 6180 - 6190
  • [5] The autonomous navigation and obstacle avoidance for USVs with ANOA deep reinforcement learning method
    Wu, Xing
    Chen, Haolei
    Chen, Changgu
    Zhong, Mingyu
    Xie, Shaorong
    Guo, Yike
    Fujita, Hamido
    KNOWLEDGE-BASED SYSTEMS, 2020, 196 (196)
  • [6] Autonomous obstacle avoidance of UAV based on deep reinforcement learning
    Yang, Songyue
    Yu, Guizhen
    Meng, Zhijun
    Wang, Zhangyu
    Li, Han
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2022, 42 (04) : 3323 - 3335
  • [7] Holistic Deep-Reinforcement-Learning-based Training for Autonomous Navigation in Crowded Environments
    Kaestner, Linh
    Meusel, Marvin
    Bhuiyan, Teham
    Lambrecht, Jens
    2023 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM, 2023, : 1302 - 1308
  • [8] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning
    Xu, Guoqiang
    Jiang, Weilai
    Wang, Zhaolei
    Wang, Yaonan
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 104 (04)
  • [9] Autonomous Obstacle Avoidance and Target Tracking of UAV Based on Deep Reinforcement Learning
    Guoqiang Xu
    Weilai Jiang
    Zhaolei Wang
    Yaonan Wang
    Journal of Intelligent & Robotic Systems, 2022, 104
  • [10] Deep-Reinforcement-Learning-Based Collision Avoidance in UAV Environment
    Ouahouah, Sihem
    Bagaa, Miloud
    Prados-Garzon, Jonathan
    Taleb, Tarik
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (06) : 4015 - 4030