Loop closure detection based on local-global similarity measurement strategies

被引:4
作者
Dian, Songyi [1 ]
Yin, Yanjie [1 ]
Wu, Chao [2 ]
Zhong, Yuzhong [1 ]
Zhang, Hong [1 ]
Yuan, Haobin [1 ]
机构
[1] Sichuan Univ, Chengdu, Peoples R China
[2] China Nucl Power Operat Co Ltd, Shenzhen, Peoples R China
关键词
loop closure detection; similarity measurement; multi-scale feature extraction; simultaneous localization and mapping; PLACE RECOGNITION; FAB-MAP; SLAM; LOCALIZATION; SCALE;
D O I
10.1117/1.JEI.31.2.023004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Loop closure detection (LCD) is an indispensable part of simultaneous localization and mapping (SLAM) systems, making it significant for eliminating accumulative trajectory error and constructing a consistent map. Focusing on visual SLAM, we propose a LCD method using local-global similarity measurement strategies. As with most deep learning-based methods, we treat the LCD problem as a classification problem. We use a pretrained VGG-16 network to obtain advanced features and a multiscale feature extraction module to integrate the features of different receptive fields. Finally, we overcome the problems of dynamic object occlusion and large-area repetitive texture using a local-global similarity measurement module to measure the similarity between current and historical frames in all dimensions. This approach decouples feature extraction from classification determination, which enables us to use the advantages of both supervised and unsupervised learning to cope with the imbalance in the number of nonloop and loop pairs. Experimental results on three different datasets showed that the proposed method is significantly better than the state-of-the-art appearance-based LCD methods in dynamic urban, suburban, and highway scenarios. (C) 2022 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 51 条
  • [1] Role of Deep Learning in Loop Closure Detection for Visual and Lidar SLAM: A Survey
    Arshad, Saba
    Kim, Gon-Woo
    [J]. SENSORS, 2021, 21 (04) : 1 - 17
  • [2] SURF: Speeded up robust features
    Bay, Herbert
    Tuytelaars, Tinne
    Van Gool, Luc
    [J]. COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 : 404 - 417
  • [3] BRIEF: Binary Robust Independent Elementary Features
    Calonder, Michael
    Lepetit, Vincent
    Strecha, Christoph
    Fua, Pascal
    [J]. COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 : 778 - 792
  • [4] ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM
    Campos, Carlos
    Elvira, Richard
    Gomez Rodriguez, Juan J.
    Montiel, Jose M. M.
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) : 1874 - 1890
  • [5] Loop Closure Detection Based on Multi-Scale Deep Feature Fusion
    Chen, Baifan
    Yuan, Dian
    Liu, Chunfa
    Wu, Qian
    [J]. APPLIED SCIENCES-BASEL, 2019, 9 (06):
  • [6] FAB-MAP: Probabilistic localization and mapping in the space of appearance
    Cummins, Mark
    Newman, Paul
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2008, 27 (06) : 647 - 665
  • [7] Appearance-only SLAM at large scale with FAB-MAP 2.0
    Cummins, Mark
    Newman, Paul
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2011, 30 (09) : 1100 - 1123
  • [8] Donahue J, 2014, PR MACH LEARN RES, V32
  • [9] 3-D Mapping With an RGB-D Camera
    Endres, Felix
    Hess, Juergen
    Sturm, Juergen
    Cremers, Daniel
    Burgard, Wolfram
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2014, 30 (01) : 177 - 187
  • [10] Facil J.M., 2019, ARXIV190209516