Visual place recognition: A survey from deep learning perspective

被引:163
作者
Zhang, Xiwu [1 ]
Wang, Lei [2 ]
Su, Yan [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Mech Engn, Nanjing 210094, Jiangsu, Peoples R China
[2] Univ Wollongong, Sch Comp & Informat Technol, Wollongong, NSW 2522, Australia
基金
澳大利亚研究理事会;
关键词
Visual place recognition; Deep learning; Visual SLAM; Survey; LARGE-SCALE; LOOP CLOSURE; FEATURE-SELECTION; IMAGE SEQUENCES; NEURAL-NETWORKS; FAB-MAP; LOCALIZATION; GRAPH; TIME; REPRESENTATIONS;
D O I
10.1016/j.patcog.2020.107760
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Visual place recognition has attracted widespread research interest in multiple fields such as computer vision and robotics. Recently, researchers have employed advanced deep learning techniques to tackle this problem. While an increasing number of studies have proposed novel place recognition methods based on deep learning, few of them has provided a whole picture about how and to what extent deep learning has been utilized for this issue. In this paper, by delving into over 200 references, we present a comprehensive survey that covers various aspects of place recognition from deep learning perspective. We first present a brief introduction of deep learning and discuss its opportunities for recognizing places. After that, we focus on existing approaches built upon convolutional neural networks, including off-the-shelf and specifically designed models as well as novel image representations. We also discuss challenging problems in place recognition and present an extensive review of the corresponding datasets. To explore the future directions, we describe open issues and some new tools, for instance, generative adversarial networks, semantic scene understanding and multi-modality feature learning for this research topic. Finally, a conclusion is drawn for this paper. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:21
相关论文
共 211 条
[1]   Principal component analysis [J].
Abdi, Herve ;
Williams, Lynne J. .
WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2010, 2 (04) :433-459
[2]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[3]  
[Anonymous], P 3 INT C LEARNING R
[4]  
[Anonymous], 2014, GARDENS POINT WALKIN
[5]  
[Anonymous], 2018, J INTELL ROBOT SYST, DOI DOI 10.1007/s10846-017-0735-y
[6]  
[Anonymous], 2018, IEEE T PATTERN ANAL, DOI DOI 10.1109/TPAMI.2017.2711011
[7]  
[Anonymous], 2017, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2017.244
[8]  
[Anonymous], 2017, PROC IEEE INT S CIRC, DOI DOI 10.1109/ISCAS.2017.8050861
[9]  
[Anonymous], 2013, PROC IEEE INT C ROBO
[10]  
[Anonymous], 2013, INT C LEARNING REPRE