Robust SLAM system based on monocular vision and LiDAR for robotic urban search and rescue

被引:0
|
作者
Chen, Xieyuanli [1 ]
Zhang, Hui [1 ]
Lu, Huimin [1 ]
Xiao, Junhao [1 ]
Qiu, Qihang [1 ]
Li, Yi [1 ]
机构
[1] Natl Univ Def Technol, Coll Mechatron & Automat, Changsha 410073, Hunan, Peoples R China
基金
美国国家科学基金会; 中国博士后科学基金;
关键词
Urban search and rescue; rescue robots; monocular SLAM; LiDAR SLAM; relocalization;
D O I
暂无
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
In this paper, we propose a monocular SLAM system for robotic urban search and rescue (USAR), based on which most USAR tasks (e.g. localization, mapping, exploration and object recognition) can be fulfilled by rescue robots with only a single camera. The proposed system can be a promising basis to implement fully autonomous rescue robots. However, the feature-based map built by the monocular SLAM is difficult for the operator to understand and use. We therefore combine the monocular SLAM with a 2D LIDAR SLAM to realize a 2D mapping and 6D localization SLAM system which can not only obtain a real scale of the environment and make the map more friendly to users, but also solve the problem that the robot pose cannot be tracked by the 2D LIDAR SLAM when the robot climbing stairs and ramps. We test our system using a real rescue robot in simulated disaster environments. The experimental results show that good performance can be achieved using the proposed system in the USAR. The system has also been successfully applied and tested in the RoboCup Rescue Robot League (RRL) competitions, where our rescue robot team entered the top 5 and won the Best in Class small robot mobility in 2016 RoboCup RRL Leipzig Germany, and the champions of 2016 and 2017 RoboCup China Open RRL competitions.
引用
收藏
页码:41 / 47
页数:7
相关论文
共 50 条
  • [1] On SLAM Based on Monocular Vision and Lidar Fusion System
    Wang, Qingqu
    Dang, Shuwen
    Shi, Hanhai
    Yang, Jianye
    2018 IEEE CSAA GUIDANCE, NAVIGATION AND CONTROL CONFERENCE (CGNCC), 2018,
  • [2] An Improved SLAM Based on the Fusion of Lidar and Monocular Vision
    Li, Yitian
    Zhang, Ren
    Li, Qihuan
    Lou, Lu
    ADVANCES IN COMPUTATIONAL INTELLIGENCE SYSTEMS, 2022, 1409 : 400 - 405
  • [3] A remotely operated robotic system for urban search and rescue
    Jeong, Kyungmin
    Kang, Jongkyu
    Lee, Geunhyung
    Lee, Sung-uk
    Seo, Yongchil
    Jung, Seungho
    Kim, Seungho
    2006 SICE-ICASE INTERNATIONAL JOINT CONFERENCE, VOLS 1-13, 2006, : 763 - +
  • [4] SLAM and 3D Semantic Reconstruction Based on the Fusion of Lidar and Monocular Vision
    Lou, Lu
    Li, Yitian
    Zhang, Qi
    Wei, Hanbing
    SENSORS, 2023, 23 (03)
  • [5] Monocular vision based SLAM for mobile robots
    Mouragnon, E.
    Lhuillier, M.
    Dhome, M.
    Dekeyser, F.
    Sayd, P.
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 3, PROCEEDINGS, 2006, : 1027 - +
  • [6] Vision-Based SLAM: Stereo and Monocular Approaches
    Thomas Lemaire
    Cyrille Berger
    Il-Kyun Jung
    Simon Lacroix
    International Journal of Computer Vision, 2007, 74 : 343 - 364
  • [7] Autonomous Thermal Vision Robotic System for Victims Recognition in Search and Rescue Missions
    Cruz Ulloa, Christyan
    Prieto Sanchez, Guillermo
    Barrientos, Antonio
    Del Cerro, Jaime
    SENSORS, 2021, 21 (21)
  • [8] SLAM of Robot based on the Fusion of Vision and LIDAR
    Xu, Yinglei
    Ou, Yongsheng
    Xu, Tiantian
    2018 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS (CBS), 2018, : 121 - 126
  • [9] A monocular vision SLAM algorithm based on particle filter
    Chen, Wei
    Wu, Tao
    Li, Zheng
    He, Han-Gen
    Jiqiren/Robot, 2008, 30 (03): : 242 - 247
  • [10] Vision-based SLAM: Stereo and monocular approaches
    Lemaire, Thomas
    Berger, Cyrille
    Jung, Il-Kyun
    Lacroix, Simon
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (03) : 343 - 364