MOR-SLAM: A New Visual SLAM System for Indoor Dynamic Environments Based on Mask Restoration

被引:1
作者
Yao, Chengzhi [1 ]
Ding, Lei [1 ]
Lan, Yonghong [2 ]
机构
[1] Jishou Univ, Coll Comp Sci & Engn, Jishou 416000, Peoples R China
[2] Xiangtan Univ, Coll Automat & Elect Informat, Xiangtan 411105, Peoples R China
基金
中国国家自然科学基金;
关键词
visual SLAM; repaired mask; dynamic environments; ORB-SLAM2;
D O I
10.3390/math11194037
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The traditional Simultaneous Localization and Mapping (SLAM) systems are based on the strong static assumption, and their performance will degrade significantly due to the presence of dynamic objects located in dynamic environments. To decrease the effects of the dynamic objects, based on the ORB-SLAM2 system, a novel dynamic semantic SLAM system called MOR-SLAM is presented using a mask repair method, which can accurately detect dynamic objects and realize high-precision positioning and tracking of the system in dynamic indoor environments. First, an instance segmentation module is added to the front end of ORB-SLAM2 to distinguish dynamic and static objects in the environment and obtain a preliminary mask. Next, to overcome the under-segmentation problem in instance segmentation, a new mask inpainting model is proposed to ensure that the integrity of object masks, which repairs large objects and small objects in the image with the depth value fusion method and morphological method, respectively. Then, a reliable basic matrix can be obtained based on the above-repaired mask. Finally, the potential dynamic feature points in the environment are detected and removed through the reliable basic matrix, and the remaining static feature points are input into the tracking module of the system to realize the high-precision positioning and tracking in dynamic environments. The experiments on the public TUM dataset show that, compared with ORB-SLAM2, the MOR-SLAM improves the absolute trajectory accuracy by 95.55%. In addition, compared with DynaSLAM and DS-SLAM on the high-dynamic sequences (fr3/w/rpy and fr3/w/static), the MOR-SLAM improves the absolute trajectory accuracy by 15.20% and 59.71%, respectively.
引用
收藏
页数:17
相关论文
共 46 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
Alcantarilla PF, 2012, IEEE INT CONF ROBOT, P1290, DOI 10.1109/ICRA.2012.6224690
[3]   A survey of augmented reality [J].
Azuma, RT .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 1997, 6 (04) :355-385
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[6]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[7]   Definition, approaches, and analysis of code duplication detection (2006-2020): a critical review [J].
Chen, Chang-Feng ;
Zain, Azlan Mohd ;
Zhou, Kai-Qing .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (23) :20507-20537
[8]   Egret Swarm Optimization Algorithm: An Evolutionary Computation Approach for Model Free Optimization [J].
Chen, Zuyan ;
Francis, Adam ;
Li, Shuai ;
Liao, Bolin ;
Xiao, Dunhui ;
Ha, Tran Thu ;
Li, Jianfeng ;
Ding, Lei ;
Cao, Xinwei .
BIOMIMETICS, 2022, 7 (04)
[9]   Moving Object Detection in Real-Time Using Stereo from a Mobile Platform [J].
Derome, Maxime ;
Plyer, Aurelien ;
Sanfourche, Martial ;
Le Besnerais, Guy .
UNMANNED SYSTEMS, 2015, 3 (04) :253-266
[10]  
Derome M, 2014, I C CONT AUTOMAT ROB, P1021, DOI 10.1109/ICARCV.2014.7064446