Loop closure detection using supervised and unsupervised deep neural networks for monocular SLAM systems

被引:57
作者
Memon, Azam Rafique [1 ]
Wang, Hesheng [1 ,2 ]
Hussain, Abid [1 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Inst Med Robot,Key Lab Marine Intelligent Equipme, Key Lab Syst Control & Informat Proc,Minist Educ, Shanghai, Peoples R China
[2] Beijing Inst Technol, Beijing Adv Innovat Ctr Intelligent Robots & Syst, Beijing, Peoples R China
关键词
Visual SLAM; Loop closure detection; Bag of words; Super dictionary; LOCALIZATION; RECOGNITION; MAP;
D O I
10.1016/j.robot.2020.103470
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The detection of true loop closure in Visual Simultaneous Localization And Mapping (vSLAM) can help in many ways, it helps in re-localization, improves the accuracy of the map, and helps in registration algorithms to obtain more accurate and consistent results. The loop closure detection is affected by many parameters, including illumination conditions, seasons, different viewpoints and mobile objects. This paper proposes a novel approach based on super dictionary different from traditional BoW dictionary that uses more advanced and more abstract features of deep learning. The proposed approach does not need to generate vocabulary, which makes it memory efficient and instead it stores exact features, which are small in number and hold very less amount of memory as compared to traditional BoW approach in which each frame holds the same amount of memory as the number of words in the vocabulary. Two deep neural networks are used together to speed up the loop closure detection and to ignore the effect of mobile objects on loop closure detection. We have compared the results with most popular Bag of Words methods DBoW2 and DBoW3, and state-of-the-art iBoW-LCD using five publicly available datasets, and the results show that the proposed method robustly performs loop closure detection and is eight times faster than the state-of-the-art approaches of a similar kind. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
[1]  
[Anonymous], 2017 IEEE 7 ANN INT
[2]  
[Anonymous], 23 INT C AUT COMP
[3]  
[Anonymous], 2018, ARXIV180801111
[4]  
[Anonymous], ROBOTICS SCI SYSTEMS
[5]  
[Anonymous], 2014, 3 INT C AN IM SOC NE
[6]   Revisiting the Inverted Indices for Billion-Scale Approximate Nearest Neighbors [J].
Baranchuk, Dmitry ;
Babenko, Artem ;
Malkov, Yury .
COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 :209-224
[7]   Robust visual semi-semantic loop closure detection by a covisibility graph and CNN features [J].
Cascianelli, Silvia ;
Costante, Gabriele ;
Bellocchio, Enrico ;
Valigi, Paolo ;
Fravolini, Mario L. ;
Ciarfuglia, Thomas A. .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 92 :53-65
[8]   Loop Closure Detection Based on Multi-Scale Deep Feature Fusion [J].
Chen, Baifan ;
Yuan, Dian ;
Liu, Chunfa ;
Wu, Qian .
APPLIED SCIENCES-BASEL, 2019, 9 (06)
[9]   Inverted Index Compression for Scalable Image Matching [J].
Chen, David M. ;
Tsai, Sam S. ;
Chandrasekhar, Vijay ;
Takacs, Gabriel ;
Vedantham, Ramakrishna ;
Grzeszczuk, Radek ;
Giro, Bernd .
2010 DATA COMPRESSION CONFERENCE (DCC 2010), 2010, :525-525
[10]  
Chollet F, 2018, DEEP LEARNING PYTHON, P386