Loop Closure Detection With Bidirectional Manifold Representation Consensus

被引:3
作者
Zhang, Kaining [1 ]
Li, Zizhuo [1 ]
Ma, Jiayi [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Loop closure detection; SLAM; vision-based navigation; place recognition; feature matching; PLACE RECOGNITION; FAB-MAP; IMAGE; SEARCH; SCALE; WORDS; BAGS;
D O I
10.1109/TITS.2022.3229364
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Loop closure detection (LCD) is an indispensable module in simultaneous localization and mapping. It is responsible to recognize pre-visited areas during the navigation of a robot, providing auxiliary information to revise pose estimation. Unlike most current methods which focus on seeking an appropriate representation of images, we propose a novel two-stage pipeline dominated by the estimation of spatial geometric relationship. Specifically, to avoid unnecessary memory costs, consecutive images are segmented into sequences as per the similarity of their global features. Then the sequence descriptor is incremen-tally inserted into hierarchical navigable small world for the construction of reference database, from which the most similar image for the query one is searched parallelly. To further identify whether the candidate pair is geometry-consistent, a feature matching method termed as bidirectional manifold representation consensus (BMRC) is proposed. It constructs local neighborhood structures of feature points via manifold representation, and formulates the matching problem into an optimization model, enabling linearithmic time complexity via a closed-form solution. Meanwhile, an accelerated version of it is introduced (BMRC*), which performs about 63% faster than BMRC in an image pair with 352 initial correspondences. Extensive experiments on nine publicly available datasets demonstrate that BMRC and BMRC* perform well in feature matching and the proposed pipeline has remarkable performance in the LCD task.
引用
收藏
页码:3949 / 3962
页数:14
相关论文
共 71 条
[1]   Fast and incremental loop closure detection with deep features and proximity graphs [J].
An, Shan ;
Zhu, Haogang ;
Wei, Dong ;
Tsintotas, Konstantinos A. ;
Gasteratos, Antonios .
JOURNAL OF FIELD ROBOTICS, 2022, 39 (04) :473-493
[2]  
An S, 2019, IEEE INT C INT ROBOT, P378, DOI [10.1109/iros40897.2019.8968043, 10.1109/IROS40897.2019.8968043]
[3]   Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words [J].
Angeli, Adrien ;
Filliat, David ;
Doncieux, Stephane ;
Meyer, Jean-Arcady .
IEEE TRANSACTIONS ON ROBOTICS, 2008, 24 (05) :1027-1037
[4]  
[Anonymous], 2011, ICCV
[5]  
Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/TPAMI.2017.2711011, 10.1109/CVPR.2016.572]
[6]  
Araujo A., 2019, Distill, V4, DOI DOI 10.23915/DISTILL.00021
[7]   Fast loop-closure detection using visual-word-vectors from image sequences [J].
Bampis, Loukas ;
Amanatiadis, Angelos ;
Gasteratos, Antonios .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2018, 37 (01) :62-82
[8]  
Bampis L, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P4530, DOI 10.1109/IROS.2016.7759667
[9]   MAGSAC: Marginalizing Sample Consensus [J].
Barath, Daniel ;
Matas, Jiri ;
Noskova, Jana .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10189-10197
[10]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359