SVG-Loop: Semantic-Visual-Geometric Information-Based Loop Closure Detection

被引:22
作者
Yuan, Zhian [1 ]
Xu, Ke [1 ]
Zhou, Xiaoyu [1 ]
Deng, Bin [1 ]
Ma, Yanxin [2 ,3 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci, Changsha 410073, Peoples R China
[2] Natl Univ Def Technol, Coll Meteorol & Oceanog, Changsha 410073, Peoples R China
[3] Hunan Key Lab Marine Detect Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
loop closure detection; bag of words; panoptic segmentation; visual simultaneous localization and mapping; PLACE RECOGNITION; BAG; LOCALIZATION; WORDS;
D O I
10.3390/rs13173520
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Loop closure detection is an important component of visual simultaneous localization and mapping (SLAM). However, most existing loop closure detection methods are vulnerable to complex environments and use limited information from images. As higher-level image information and multi-information fusion can improve the robustness of place recognition, a semantic-visual-geometric information-based loop closure detection algorithm (SVG-Loop) is proposed in this paper. In detail, to reduce the interference of dynamic features, a semantic bag-of-words model was firstly constructed by connecting visual features with semantic labels. Secondly, in order to improve detection robustness in different scenes, a semantic landmark vector model was designed by encoding the geometric relationship of the semantic graph. Finally, semantic, visual, and geometric information was integrated by fuse calculation of the two modules. Compared with art-of-the-state methods, experiments on the TUM RBG-D dataset, KITTI odometry dataset, and practical environment show that SVG-Loop has advantages in complex environments with varying light, changeable weather, and dynamic interference.
引用
收藏
页数:24
相关论文
共 51 条
  • [1] Fast and Incremental Method for Loop-Closure Detection Using Bags of Visual Words
    Angeli, Adrien
    Filliat, David
    Doncieux, Stephane
    Meyer, Jean-Arcady
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2008, 24 (05) : 1027 - 1037
  • [2] Arandjelovic R, 2018, IEEE T PATTERN ANAL, V40, P1437, DOI [10.1109/TPAMI.2017.2711011, 10.1109/CVPR.2016.572]
  • [3] Fast loop-closure detection using visual-word-vectors from image sequences
    Bampis, Loukas
    Amanatiadis, Angelos
    Gasteratos, Antonios
    [J]. INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2018, 37 (01) : 62 - 82
  • [4] Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
  • [5] Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
    Cadena, Cesar
    Carlone, Luca
    Carrillo, Henry
    Latif, Yasir
    Scaramuzza, Davide
    Neira, Jose
    Reid, Ian
    Leonard, John J.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) : 1309 - 1332
  • [6] Robust Place Recognition With Stereo Sequences
    Cadena, Cesar
    Galvez-Lopez, Dorian
    Tardos, Juan D.
    Neira, Jose
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (04) : 871 - 885
  • [7] Robust visual semi-semantic loop closure detection by a covisibility graph and CNN features
    Cascianelli, Silvia
    Costante, Gabriele
    Bellocchio, Enrico
    Valigi, Paolo
    Fravolini, Mario L.
    Ciarfuglia, Thomas A.
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 92 : 53 - 65
  • [8] Semantic Loop Closure Detection With Instance-Level Inconsistency Removal in Dynamic Industrial Scenes
    Chen, Haosheng
    Zhang, Ge
    Ye, Yangdong
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (03) : 2030 - 2040
  • [9] A Survey on Visual Place Recognition for Mobile Robots Localization
    Chen, Yutian
    Gan, Wenyan
    Zhang, Lei
    Liu, Chong
    Wang, Xianlei
    [J]. 2017 14TH WEB INFORMATION SYSTEMS AND APPLICATIONS CONFERENCE (WISA 2017), 2017, : 187 - 192
  • [10] Chen ZT, 2017, IEEE INT C INT ROBOT, P9, DOI 10.1109/IROS.2017.8202131