Loop Closure Detection With Bidirectional Manifold Representation Consensus

被引:3
作者
Zhang, Kaining [1 ]
Li, Zizhuo [1 ]
Ma, Jiayi [1 ]
机构
[1] Wuhan Univ, Elect Informat Sch, Wuhan 430072, Peoples R China
基金
中国国家自然科学基金;
关键词
Loop closure detection; SLAM; vision-based navigation; place recognition; feature matching; PLACE RECOGNITION; FAB-MAP; IMAGE; SEARCH; SCALE; WORDS; BAGS;
D O I
10.1109/TITS.2022.3229364
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Loop closure detection (LCD) is an indispensable module in simultaneous localization and mapping. It is responsible to recognize pre-visited areas during the navigation of a robot, providing auxiliary information to revise pose estimation. Unlike most current methods which focus on seeking an appropriate representation of images, we propose a novel two-stage pipeline dominated by the estimation of spatial geometric relationship. Specifically, to avoid unnecessary memory costs, consecutive images are segmented into sequences as per the similarity of their global features. Then the sequence descriptor is incremen-tally inserted into hierarchical navigable small world for the construction of reference database, from which the most similar image for the query one is searched parallelly. To further identify whether the candidate pair is geometry-consistent, a feature matching method termed as bidirectional manifold representation consensus (BMRC) is proposed. It constructs local neighborhood structures of feature points via manifold representation, and formulates the matching problem into an optimization model, enabling linearithmic time complexity via a closed-form solution. Meanwhile, an accelerated version of it is introduced (BMRC*), which performs about 63% faster than BMRC in an image pair with 352 initial correspondences. Extensive experiments on nine publicly available datasets demonstrate that BMRC and BMRC* perform well in feature matching and the proposed pipeline has remarkable performance in the LCD task.
引用
收藏
页码:3949 / 3962
页数:14
相关论文
共 71 条
[41]   Robust feature matching via neighborhood manifold representation consensus [J].
Ma, Jiayi ;
Li, Zizhuo ;
Zhang, Kaining ;
Shao, Zhenfeng ;
Xiao, Guobao .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 183 :196-209
[42]  
Ma JY, 2019, INT J COMPUT VISION, V127, P512, DOI [10.1007/s11263-018-1117-z, 10.1109/TMAG.2017.2763198]
[43]   Robust Point Matching via Vector Field Consensus [J].
Ma, Jiayi ;
Zhao, Ji ;
Tian, Jinwen ;
Yuille, Alan L. ;
Tu, Zhuowen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (04) :1706-1721
[44]   Efficient and Robust Approximate Nearest Neighbor Search Using Hierarchical Navigable Small World Graphs [J].
Malkov, Yu A. ;
Yashunin, D. A. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (04) :824-836
[45]  
Miech A, 2018, Arxiv, DOI arXiv:1706.06905
[46]  
Mur-Artal R, 2014, IEEE INT CONF ROBOT, P846, DOI 10.1109/ICRA.2014.6906953
[47]   Automatic Visual Bag-of-Words for Online Robot Navigation and Mapping [J].
Nicosevici, Tudor ;
Garcia, Rafael .
IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (04) :886-898
[48]   Large-Scale Image Retrieval with Attentive Deep Local Features [J].
Noh, Hyeonwoo ;
Araujo, Andre ;
Sim, Jack ;
Weyand, Tobias ;
Han, Bohyung .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3476-3485
[49]   Deep Architectures and Ensembles for Semantic Video Classification [J].
Ong, Eng-Jon ;
Husain, Syed Sameed ;
Bober-Irizar, Mikel ;
Bober, Miroslaw .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (12) :3568-3582
[50]   Fine-Tuning CNN Image Retrieval with No Human Annotation [J].
Radenovic, Filip ;
Tolias, Giorgos ;
Chum, Ondrej .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (07) :1655-1668