Visual SLAM Based on Semantic Segmentation and Geometric Constraints for Dynamic Indoor Environments

被引:21
作者
Yang, Shiqiang [1 ]
Zhao, Cheng [1 ]
Wu, Zhengkun [2 ]
Wang, Yan [1 ]
Wang, Guodong [1 ]
Li, Dexin [1 ]
机构
[1] Xian Univ Technol, Sch Mech & Precis Instrument Engn, Xian 710048, Peoples R China
[2] China Aerosp Sci & Ind Corp 210, Res Inst 6, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Heuristic algorithms; Simultaneous localization and mapping; Information filters; Filtering algorithms; Data mining; Visual SLAM; ORB-SLAM2; dynamic feature filtering; semantic map;
D O I
10.1109/ACCESS.2022.3185766
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous localization and mapping (SLAM), a core technology of mobile robots and autonomous driving, has received more and more attention in recent years. However, most of the existing visual SLAM algorithms do not consider the impact of dynamic objects on the visual SLAM system, resulting in significant system positioning errors and high map redundancy. Based on the ORB-SLAM2 algorithm, this paper combines semantic information and a geometric constraint algorithm based on feature point homogenization to improve the positioning accuracy of the SLAM system. Aiming at the problem that the feature points extracted by the ORB-SLAM2 algorithm are easily concentrated, and the extraction rate is low in the weak texture area, a feature point homogenization algorithm based on quadtree and adaptive threshold is proposed to improve the uniformity of feature point extraction. In addition, in view of the impact of dynamic targets on the SLAM system, the dynamic information in the scene is filtered out through the semantic segmentation network and the motion consistency detection algorithm, and the static feature points obtained after filtering are used to estimate the camera pose. Then, a semantic map is constructed after filtering out the dynamic point cloud according to the semantic information. Finally, the test results on Oxford and TUM datasets show that the uniformity of feature points extracted by the improved algorithm is increased by 56.3%. The positioning error of visual SLAM is reduced by 68.8% on average, and the constructed semantic map has rich semantic information and less redundancy.
引用
收藏
页码:69636 / 69649
页数:14
相关论文
共 34 条
[1]   DDL-SLAM: A Robust RGB-D SLAM in Dynamic Environments Combined With Deep Learning [J].
Ai, Yongbao ;
Rui, Ting ;
Lu, Ming ;
Fu, Lei ;
Liu, Shuai ;
Wang, Song .
IEEE ACCESS, 2020, 8 :162335-162342
[2]  
Azartash Haleh, 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), P1280, DOI 10.1109/ICASSP.2014.6853803
[3]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[4]   DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM [J].
Bescos, Berta ;
Campos, Carlos ;
Tardos, Juan D. ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) :5191-5198
[5]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[6]   Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving [J].
Bresson, Guillaume ;
Alsayed, Zayed ;
Yu, Li ;
Glaser, Sebastien .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2017, 2 (03) :194-220
[7]   BRIEF: Binary Robust Independent Elementary Features [J].
Calonder, Michael ;
Lepetit, Vincent ;
Strecha, Christoph ;
Fua, Pascal .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :778-792
[8]  
Chuanping Geng, 2020, Journal of Physics: Conference Series, V1616, DOI 10.1088/1742-6596/1616/1/012026
[9]   DoubleU-Net: A Deep Convolutional Neural Network for Medical Image Segmentation [J].
Jha, Debesh ;
Riegler, Michael A. ;
Johansen, Dag ;
Halvorsen, Pal ;
Johansen, Havard D. .
2020 IEEE 33RD INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS(CBMS 2020), 2020, :558-564
[10]   Effective Background Model-Based RGB-D Dense Visual Odometry in a Dynamic Environment [J].
Kim, Deok-Hwa ;
Kim, Jong-Hwan .
IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) :1565-1573