MOR-SLAM: A New Visual SLAM System for Indoor Dynamic Environments Based on Mask Restoration

被引:1
作者
Yao, Chengzhi [1 ]
Ding, Lei [1 ]
Lan, Yonghong [2 ]
机构
[1] Jishou Univ, Coll Comp Sci & Engn, Jishou 416000, Peoples R China
[2] Xiangtan Univ, Coll Automat & Elect Informat, Xiangtan 411105, Peoples R China
基金
中国国家自然科学基金;
关键词
visual SLAM; repaired mask; dynamic environments; ORB-SLAM2;
D O I
10.3390/math11194037
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The traditional Simultaneous Localization and Mapping (SLAM) systems are based on the strong static assumption, and their performance will degrade significantly due to the presence of dynamic objects located in dynamic environments. To decrease the effects of the dynamic objects, based on the ORB-SLAM2 system, a novel dynamic semantic SLAM system called MOR-SLAM is presented using a mask repair method, which can accurately detect dynamic objects and realize high-precision positioning and tracking of the system in dynamic indoor environments. First, an instance segmentation module is added to the front end of ORB-SLAM2 to distinguish dynamic and static objects in the environment and obtain a preliminary mask. Next, to overcome the under-segmentation problem in instance segmentation, a new mask inpainting model is proposed to ensure that the integrity of object masks, which repairs large objects and small objects in the image with the depth value fusion method and morphological method, respectively. Then, a reliable basic matrix can be obtained based on the above-repaired mask. Finally, the potential dynamic feature points in the environment are detected and removed through the reliable basic matrix, and the remaining static feature points are input into the tracking module of the system to realize the high-precision positioning and tracking in dynamic environments. The experiments on the public TUM dataset show that, compared with ORB-SLAM2, the MOR-SLAM improves the absolute trajectory accuracy by 95.55%. In addition, compared with DynaSLAM and DS-SLAM on the high-dynamic sequences (fr3/w/rpy and fr3/w/static), the MOR-SLAM improves the absolute trajectory accuracy by 15.20% and 59.71%, respectively.
引用
收藏
页数:17
相关论文
共 46 条
[11]   Simultaneous localization and mapping: Part I [J].
Durrant-Whyte, Hugh ;
Bailey, Tim .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2006, 13 (02) :99-108
[12]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625
[13]   LSD-SLAM: Large-Scale Direct Monocular SLAM [J].
Engel, Jakob ;
Schoeps, Thomas ;
Cremers, Daniel .
COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 :834-849
[14]   An Improved Moving Target Detecting and Tracking Based On Optical Flow Technique and Kalman Filter [J].
Fang, Yuqiang ;
Dai, Bin .
ICCSSE 2009: PROCEEDINGS OF 2009 4TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, 2009, :1197-1202
[15]  
He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
[16]   DETERMINING OPTICAL-FLOW [J].
HORN, BKP ;
SCHUNCK, BG .
ARTIFICIAL INTELLIGENCE, 1981, 17 (1-3) :185-203
[17]  
Huang H., 2009, A survey of mobile indoor navigation systems, P305, DOI 10.1007/978-3-642-03294-3_20
[18]  
Klein George, 2007, P1
[19]   Moving Object Detection by Multi-View Geometric Techniques from a Single Camera Mounted Robot [J].
Kundu, Abhijit ;
Krishna, K. Madhava ;
Sivaswamy, Jayanthi .
2009 IEEE-RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS, 2009, :4306-4312
[20]   Deep learning [J].
LeCun, Yann ;
Bengio, Yoshua ;
Hinton, Geoffrey .
NATURE, 2015, 521 (7553) :436-444