SVG-Loop: Semantic-Visual-Geometric Information-Based Loop Closure Detection

被引:22
作者
Yuan, Zhian [1 ]
Xu, Ke [1 ]
Zhou, Xiaoyu [1 ]
Deng, Bin [1 ]
Ma, Yanxin [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci, Changsha 410073, Peoples R China
[2] Natl Univ Def Technol, Coll Meteorol & Oceanog, Changsha 410073, Peoples R China
[3] Hunan Key Lab Marine Detect Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
loop closure detection; bag of words; panoptic segmentation; visual simultaneous localization and mapping; PLACE RECOGNITION; BAG; LOCALIZATION; WORDS;
D O I
10.3390/rs13173520
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Loop closure detection is an important component of visual simultaneous localization and mapping (SLAM). However, most existing loop closure detection methods are vulnerable to complex environments and use limited information from images. As higher-level image information and multi-information fusion can improve the robustness of place recognition, a semantic-visual-geometric information-based loop closure detection algorithm (SVG-Loop) is proposed in this paper. In detail, to reduce the interference of dynamic features, a semantic bag-of-words model was firstly constructed by connecting visual features with semantic labels. Secondly, in order to improve detection robustness in different scenes, a semantic landmark vector model was designed by encoding the geometric relationship of the semantic graph. Finally, semantic, visual, and geometric information was integrated by fuse calculation of the two modules. Compared with art-of-the-state methods, experiments on the TUM RBG-D dataset, KITTI odometry dataset, and practical environment show that SVG-Loop has advantages in complex environments with varying light, changeable weather, and dynamic interference.
引用
收藏
页数:24
相关论文
共 51 条
  • [21] Khan S, 2015, IEEE INT CONF ROBOT, P5441, DOI 10.1109/ICRA.2015.7139959
  • [22] Panoptic Feature Pyramid Networks
    Kirillov, Alexander
    Girshick, Ross
    He, Kaiming
    Dollar, Piotr
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 6392 - 6401
  • [23] Panoptic Segmentation
    Kirillov, Alexander
    He, Kaiming
    Girshick, Ross
    Rother, Carsten
    Dollar, Piotr
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 9396 - 9405
  • [24] Feature Pyramid Networks for Object Detection
    Lin, Tsung-Yi
    Dollar, Piotr
    Girshick, Ross
    He, Kaiming
    Hariharan, Bharath
    Belongie, Serge
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 936 - 944
  • [25] Distinctive image features from scale-invariant keypoints
    Lowe, DG
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) : 91 - 110
  • [26] Visual Place Recognition: A Survey
    Lowry, Stephanie
    Suenderhauf, Niko
    Newman, Paul
    Leonard, John J.
    Cox, David
    Corke, Peter
    Milford, Michael J.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (01) : 1 - 19
  • [27] A Survey on Deep Visual Place Recognition
    Masone, Carlo
    Caputo, Barbara
    [J]. IEEE ACCESS, 2021, 9 : 19516 - 19547
  • [28] Merrill N, 2019, IEEE INT C INT ROBOT, P4554, DOI [10.1109/iros40897.2019.8968159, 10.1109/IROS40897.2019.8968159]
  • [29] Milford MJ, 2012, IEEE INT CONF ROBOT, P1643, DOI 10.1109/ICRA.2012.6224623
  • [30] Muja M, 2009, VISAPP 2009: PROCEEDINGS OF THE FOURTH INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 1, P331