Loop closure detection based on local-global similarity measurement strategies

被引:4
作者
Dian, Songyi [1 ]
Yin, Yanjie [1 ]
Wu, Chao [2 ]
Zhong, Yuzhong [1 ]
Zhang, Hong [1 ]
Yuan, Haobin [1 ]
机构
[1] Sichuan Univ, Chengdu, Peoples R China
[2] China Nucl Power Operat Co Ltd, Shenzhen, Peoples R China
关键词
loop closure detection; similarity measurement; multi-scale feature extraction; simultaneous localization and mapping; PLACE RECOGNITION; FAB-MAP; SLAM; LOCALIZATION; SCALE;
D O I
10.1117/1.JEI.31.2.023004
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Loop closure detection (LCD) is an indispensable part of simultaneous localization and mapping (SLAM) systems, making it significant for eliminating accumulative trajectory error and constructing a consistent map. Focusing on visual SLAM, we propose a LCD method using local-global similarity measurement strategies. As with most deep learning-based methods, we treat the LCD problem as a classification problem. We use a pretrained VGG-16 network to obtain advanced features and a multiscale feature extraction module to integrate the features of different receptive fields. Finally, we overcome the problems of dynamic object occlusion and large-area repetitive texture using a local-global similarity measurement module to measure the similarity between current and historical frames in all dimensions. This approach decouples feature extraction from classification determination, which enables us to use the advantages of both supervised and unsupervised learning to cope with the imbalance in the number of nonloop and loop pairs. Experimental results on three different datasets showed that the proposed method is significantly better than the state-of-the-art appearance-based LCD methods in dynamic urban, suburban, and highway scenarios. (C) 2022 SPIE and IS&T
引用
收藏
页数:21
相关论文
共 51 条
[1]  
[Anonymous], 2014, COMPUT RES REPOSITOR
[2]   Role of Deep Learning in Loop Closure Detection for Visual and Lidar SLAM: A Survey [J].
Arshad, Saba ;
Kim, Gon-Woo .
SENSORS, 2021, 21 (04) :1-17
[3]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[4]   BRIEF: Binary Robust Independent Elementary Features [J].
Calonder, Michael ;
Lepetit, Vincent ;
Strecha, Christoph ;
Fua, Pascal .
COMPUTER VISION-ECCV 2010, PT IV, 2010, 6314 :778-792
[5]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[6]   Loop Closure Detection Based on Multi-Scale Deep Feature Fusion [J].
Chen, Baifan ;
Yuan, Dian ;
Liu, Chunfa ;
Wu, Qian .
APPLIED SCIENCES-BASEL, 2019, 9 (06)
[7]   FAB-MAP: Probabilistic localization and mapping in the space of appearance [J].
Cummins, Mark ;
Newman, Paul .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2008, 27 (06) :647-665
[8]   Appearance-only SLAM at large scale with FAB-MAP 2.0 [J].
Cummins, Mark ;
Newman, Paul .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2011, 30 (09) :1100-1123
[9]  
Donahue J, 2014, PR MACH LEARN RES, V32
[10]   3-D Mapping With an RGB-D Camera [J].
Endres, Felix ;
Hess, Juergen ;
Sturm, Juergen ;
Cremers, Daniel ;
Burgard, Wolfram .
IEEE TRANSACTIONS ON ROBOTICS, 2014, 30 (01) :177-187