DyStSLAM: an efficient stereo vision SLAM system in dynamic environment

被引:8
作者
Li, Xing [1 ]
Shen, Yehu [1 ]
Lu, Jinbin [1 ]
Jiang, Quansheng [1 ]
Xie, Ou [1 ]
Yang, Yong [1 ]
Zhu, Qixin [1 ]
机构
[1] Suzhou Univ Sci & Technol, Sch Mech Engn, Suzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
visual SLAM; dynamic environment; object tracking; 3D reconstruction; VERSATILE; TRACKING; ROBUST;
D O I
10.1088/1361-6501/ac97b1
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Simultaneous localization and mapping (SLAM) is the basis for many robotic applications. Most SLAM algorithms are based on the assumption that the scene is static. In real-world applications, moving objects are inevitable, which will greatly impact the ego-pose estimation accuracy. This paper presents DyStSLAM, a visual SLAM system with a stereo configuration that can efficiently identify moving objects and accomplish dynamic data association. First of all, DyStSLAM extracts feature points, estimates the disparity map, and performs instance segmentation simultaneously. Then, the obtained results are combined to estimate the motion confidence and discriminate between moving objects and static ones. A confidence based matching algorithm is proposed to associate dynamic objects and estimate the pose of each moving object. At the same time, static objects are used to estimate the pose of the camera. Finally, after nonlinear optimization, a sparse point cloud map of both static background and dynamic objects is constructed. Compared with ORB-SLAM2, the proposed method outperforms by 31% for absolute trajectory error on the KITTI dataset.
引用
收藏
页数:16
相关论文
共 48 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   DOT: Dynamic Object Tracking for Visual SLAM [J].
Ballester, Irene ;
Fontan, Alejandro ;
Civera, Javier ;
Strobl, Klaus H. ;
Triebel, Rudolph .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :11705-11711
[3]   Stereo camera visual SLAM with hierarchical masking and motion-state classification at outdoor construction sites containing large dynamic objects [J].
Bao, Runqiu ;
Komatsu, Ren ;
Miyagusuku, Renato ;
Chino, Masaki ;
Yamashita, Atsushi ;
Asama, Hajime .
ADVANCED ROBOTICS, 2021, 35 (3-4) :228-241
[4]   DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM [J].
Bescos, Berta ;
Campos, Carlos ;
Tardos, Juan D. ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) :5191-5198
[5]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[6]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[7]   Visual navigation for mobile robots: A survey [J].
Bonin-Font, Francisco ;
Ortiz, Alberto ;
Oliver, Gabriel .
JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2008, 53 (03) :263-296
[8]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[9]   Vision and laser fused SLAM in indoor environments with multi-robot system [J].
Chen, Haoyao ;
Huang, Hailin ;
Qin, Ye ;
Li, Yanjie ;
Liu, Yunhliz .
ASSEMBLY AUTOMATION, 2019, 39 (02) :297-307
[10]   MonoSLAM: Real-time single camera SLAM [J].
Davison, Andrew J. ;
Reid, Ian D. ;
Molton, Nicholas D. ;
Stasse, Olivier .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) :1052-1067