Visual SLAM in dynamic environments based on object detection

被引:27
作者
Ai, Yong-bao [1 ]
Rui, Ting [1 ]
Yang, Xiao-qiang [1 ]
He, Jia-lin [2 ]
Fu, Lei [1 ]
Li, Jian-bin [3 ]
Lu, Ming [2 ]
机构
[1] Peoples Liberat Army Engn Univ, Coll Field Engn, Nanjing 210007, Peoples R China
[2] JinKen Coll Technol, Nanjing 211156, Peoples R China
[3] Acad Mil Sci, Res Inst Chem Def, Beijing 102205, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; Object detection; Dynamic object probability model; Dynamic environments; SIMULTANEOUS LOCALIZATION;
D O I
10.1016/j.dt.2020.09.0122214-9147/
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
A great number of visual simultaneous localization and mapping (VSLAM) systems need to assume static features in the environment. However, moving objects can vastly impair the performance of a VSLAM system which relies on the static-world assumption. To cope with this challenging topic, a real-time and robust VSLAM system based on ORB-SLAM2 for dynamic environments was proposed. To reduce the influence of dynamic content, we incorporate the deep-learning-based object detection method in the visual odometry, then the dynamic object probability model is added to raise the efficiency of object detection deep neural network and enhance the real-time performance of our system. Experiment with both on the TUM and KITTI benchmark dataset, as well as in a real-world environment, the results clarify that our method can significantly reduce the tracking error or drift, enhance the robustness, accuracy and stability of the VSLAM system in dynamic scenes. (c) 2020 China Ordnance Society. Publishing services by Elsevier B.V. on behalf of KeAi Communications Co. Ltd. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/ licenses/by-nc-nd/4.0/).
引用
收藏
页码:1712 / 1721
页数:10
相关论文
共 48 条
[1]  
Alcantarilla PF, 2012, ROB AUT ICRA 2012 IE
[2]  
[Anonymous], 2016, P COMPUTER VISION EC
[3]   SLAM in dynamic environments via ML-RANSAC [J].
Bahraini, Masoud S. ;
Bozorg, Mohammad ;
Rad, Ahmad B. .
MECHATRONICS, 2018, 49 :105-118
[4]  
Barnes D, 2018, IEEE INT CONF ROBOT, P1894
[5]  
Bibby C., 2007, Proc. Robot. Sci. Syst
[6]  
Bleser G, 2006, INT SYM MIX AUGMENT, P223
[7]  
Bloesch M, 2015, IEEE INT C INT ROBOT, P298, DOI 10.1109/IROS.2015.7353389
[8]  
Bochkovskiy A, 2020, Yolov4: optimal speed and accuracy of object detection, DOI 10.48550/ARXIV.2004.10934
[9]   Robust Visual Localization in Dynamic Environments Based on Sparse Motion Removal [J].
Cheng, Jiyu ;
Wang, Chaoqun ;
Meng, Max Q-H .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (02) :658-669
[10]  
DeokHwa K, 2015, ROBOT INTELLIGENCE T