CFP-SLAM: A Real-time Visual SLAM Based on Coarse-to-Fine Probability in Dynamic Environments

被引:26
作者
Hu, Xinggang [1 ]
Zhang, Yunzhou [1 ]
Cao, Zhenzhong [1 ]
Ma, Rong [2 ]
Wu, Yanmin [3 ]
Deng, Zhiqiang [1 ]
Sun, Wenkai [1 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
[2] Beijing Simulat Ctr, Beijing, Peoples R China
[3] Peking Univ, Sch Elect & Comp Engn, Shenzhen, Peoples R China
来源
2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) | 2022年
关键词
RGB-D SLAM; MOTION REMOVAL;
D O I
10.1109/IROS47612.2022.9981826
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The dynamic factors in the environment will lead to the decline of camera localization accuracy due to the violation of the static environment assumption of SLAM algorithm. Recently, some related works generally use the combination of semantic constraints and geometric constraints to deal with dynamic objects, but problems can still be raised, such as poor real-time performance, easy to treat people as rigid bodies, and poor performance in low dynamic scenes. In this paper, a dynamic scene-oriented visual SLAM algorithm based on object detection and coarse-to-fine static probability named CFP-SLAM is proposed. The algorithm combines semantic constraints and geometric constraints to calculate the static probability of objects, keypoints and map points, and takes them as weights to participate in camera pose estimation. Extensive evaluations show that our approach can achieve almost the best results in high dynamic and low dynamic scenarios compared to the state-of-the-art dynamic SLAM methods, and shows quite high real-time ability.
引用
收藏
页码:4399 / 4406
页数:8
相关论文
共 26 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[3]   GMS: Grid-based Motion Statistics for Fast, Ultra-robust Feature Correspondence [J].
Bian, JiaWang ;
Lin, Wen-Yan ;
Matsushita, Yasuyuki ;
Yeung, Sai-Kit ;
Nguyen, Tan-Dat ;
Cheng, Ming-Ming .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2828-2837
[4]  
Brasch N, 2018, IEEE INT C INT ROBOT, P393, DOI 10.1109/IROS.2018.8593828
[5]   RGB-D SLAM in Dynamic Environments Using Point Correlations [J].
Dai, Weichen ;
Zhang, Yu ;
Li, Ping ;
Fang, Zheng ;
Scherer, Sebastian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :373-389
[6]   BlitzNet: A Real-Time Deep Network for Scene Understanding [J].
Dvornik, Nikita ;
Shmelkov, Konstantin ;
Mairal, Julien ;
Schmid, Cordelia .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4174-4182
[7]   Blitz-SLAM: A semantic SLAM in dynamic environments [J].
Fan, Yingchun ;
Zhang, Qichi ;
Tang, Yuliang ;
Liu, Shaofen ;
Han, Hong .
PATTERN RECOGNITION, 2022, 121
[8]  
He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/ICCV.2017.322, 10.1109/TPAMI.2018.2844175]
[9]   Towards Real-time Semantic RGB-D SLAM in Dynamic Environments [J].
Ji, Tete ;
Wang, Chen ;
Xie, Lihua .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :11175-11181
[10]   Effective Background Model-Based RGB-D Dense Visual Odometry in a Dynamic Environment [J].
Kim, Deok-Hwa ;
Kim, Jong-Hwan .
IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) :1565-1573