SemanticTopoLoop: Semantic Loop Closure With 3D Topological Graph Based on Quadric-Level Object Map

被引:0
作者
Cao, Zhenzhong [1 ,2 ,3 ]
Zhang, Qianyi [1 ,2 ,3 ]
Guang, Jinzheng [1 ,2 ,3 ]
Wu, Shichao [1 ,2 ,3 ]
Hu, Zhengxi [1 ,2 ,3 ]
Liu, Jingtai [1 ,2 ,3 ]
机构
[1] Inst Robot & Automat Informat Syst, Tianjin 300350, Peoples R China
[2] Tianjin Key Lab Intelligent Robot, Tianjin 300350, Peoples R China
[3] Nankai Univ, TBI Ctr, Tianjin 300350, Peoples R China
基金
中国国家自然科学基金;
关键词
SLAM; localization; semantic scene understanding; VERSATILE; ROBUST;
D O I
10.1109/LRA.2024.3374169
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Loop closure, as one of the crucial components in SLAM, plays an essential role in correcting accumulated errors. Traditional appearance-based methods, such as bag-of-words models, are often limited by local 2D features and the volume of training data, making them less versatile and robust in real-world scenarios, leading to missed detections or false positive detections in loop closure. To address these issues, we first propose a semantic loop detection method based on quadric-level object map topology, which represents scenes through the topological graph of quadric-level objects and achieves accurate loop closure at a wide field of view by comparing differences in the topological graphs. Next, to solve the data association problem between frame and map in loop closure, we propose an object data association method based on multi-level verification, which can associate 2D semantic features of the current frame with 3D object landmarks of the map. Finally, we integrate these two methods into a complete object-aware SLAM system. Qualitative experiments and ablation studies demonstrate the effectiveness and robustness of the proposed object-level data association algorithm. Quantitative experiments show that our semantic loop closure method outperforms existing state-of-the-art methods in terms of precision, recall, and localization accuracy metrics.
引用
收藏
页码:4257 / 4264
页数:8
相关论文
共 20 条
  • [1] ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM
    Campos, Carlos
    Elvira, Richard
    Gomez Rodriguez, Juan J.
    Montiel, Jose M. M.
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) : 1874 - 1890
  • [2] Object-Aware SLAM Based on Efficient Quadric Initialization and Joint Data Association
    Cao, ZhenZhong
    Zhang, Yunzhou
    Tian, Rui
    Ma, Rong
    Hu, Xinggang
    Coleman, Sonya
    Kerr, Dermot
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 9802 - 9809
  • [3] Bags of Binary Words for Fast Place Recognition in Image Sequences
    Galvez-Lopez, Dorian
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2012, 28 (05) : 1188 - 1197
  • [4] He K., 2017, P IEEE INT C COMPUTE, P2961
  • [5] The Hungarian Method for the assignment problem
    Kuhn, HW
    [J]. NAVAL RESEARCH LOGISTICS, 2005, 52 (01) : 7 - 21
  • [6] Topology Aware Object-Level Semantic Mapping Towards More Robust Loop Closure
    Lin, Shiqi
    Wang, Jikai
    Xu, Meng
    Zhao, Hao
    Chen, Zonghai
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 7041 - 7048
  • [7] Distinctive image features from scale-invariant keypoints
    Lowe, DG
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) : 91 - 110
  • [8] Mu BP, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P4602, DOI 10.1109/IROS.2016.7759677
  • [9] ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
    Mur-Artal, Raul
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2017, 33 (05) : 1255 - 1262
  • [10] ORB-SLAM: A Versatile and Accurate Monocular SLAM System
    Mur-Artal, Raul
    Montiel, J. M. M.
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2015, 31 (05) : 1147 - 1163