Semantic Loopback Detection Method Based on Instance Segmentation and Visual SLAM in Autonomous Driving

被引:2
作者
Huang, Li [1 ]
Zhu, Zhe [1 ]
Yun, Juntong [2 ,3 ,4 ]
Xu, Manman [2 ,3 ,4 ]
Liu, Ying [2 ,4 ]
Sun, Ying [2 ,3 ,4 ]
Hu, Jun [2 ,3 ,4 ]
Li, Fazeng [2 ,3 ,4 ]
机构
[1] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Precis Mfg Res Inst, Res Ctr Biomimet Robot & Intelligent Measurement &, Key Lab Met Equipment & Control Technol,Minist Edu, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Longzhong Lab, Xiangyang 441000, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; image segmentation; semantic information; data association; loopback detection; autonomous driving; IMAGE; PERCEPTION;
D O I
10.1109/TITS.2023.3315231
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Autonomous driving has gradually become a research hotspot in recent years, but the robustness of loopback detection in complex environments such as dynamic and weak textures needs to be improved. A semantic loopback detection method is proposed based on instance segmentation and visual SLAM to make sufficient use of semantic information in autonomous driving. The proposed method combines image segmentation and visual SLAM (Simultaneous Localization and Mapping) to construct a semantic SLAM system. What's more, a data association method that combines semantic and geometric information is proposed to improve the traditional loopback detection method by using semantic information to increase the accuracy of loopback detection. The result of experiment on the TUM public dataset shows that the loopback detection accuracy of the improved loopback detection method is higher than that of the bag-of-words method in all four datasets, and our proposed algorithm can effectively improve the accuracy of loopback detection of the SLAM system in general.
引用
收藏
页码:3118 / 3127
页数:10
相关论文
共 50 条
  • [41] Semantic Image Segmentation for Autonomous Driving Using Fully Convolutional Networks
    Kaymak, Cagri
    Ucar, Ayegul
    [J]. 2019 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND DATA PROCESSING (IDAP 2019), 2019,
  • [42] LEARNING UNCERTAINTY FOR SAFETY-ORIENTED SEMANTIC SEGMENTATION IN AUTONOMOUS DRIVING
    Besnier, Victor
    Picard, David
    Briot, Alexandre
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3353 - 3357
  • [43] Ground-Aware Point Cloud Semantic Segmentation for Autonomous Driving
    Wu, Jian
    Jiao, Jianbo
    Yang, Qingxiong
    Zha, Zheng-Jun
    Chen, Xuejin
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 971 - 979
  • [44] Combination of Computer Vision Detection and Segmentation for Autonomous Driving
    Tseng, Yu-Ho
    Jan, Shau-Shiun
    [J]. 2018 IEEE/ION POSITION, LOCATION AND NAVIGATION SYMPOSIUM (PLANS), 2018, : 1047 - 1052
  • [45] Visual SLAM Framework Based on Segmentation with the Improvement of Loop Closure Detection in Dynamic Environments
    Sun, Leyuan
    Singh, Rohan P.
    Kanehiro, Fumio
    [J]. JOURNAL OF ROBOTICS AND MECHATRONICS, 2021, 33 (06) : 1384 - 1396
  • [46] Deep Dual-Modal Traffic Objects Instance Segmentation Method Using Camera and LIDAR Data for Autonomous Driving
    Geng, Keke
    Dong, Ge
    Yin, Guodong
    Hu, Jingyu
    [J]. REMOTE SENSING, 2020, 12 (20) : 1 - 22
  • [47] SimVODIS: Simultaneous Visual Odometry, Object Detection, and Instance Segmentation
    Kim, Ue-Hwan
    Kim, Se-Ho
    Kim, Jong-Hwan
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) : 428 - 441
  • [48] A scene flow estimation method based on fusion segmentation and redistribution for autonomous driving
    Hu, Fuzhi
    Zhang, Zili
    Hu, Xing
    Chen, Tingting
    Guo, Hai
    Quan, Yue
    Zhang, Pingjuan
    [J]. IET CONTROL THEORY AND APPLICATIONS, 2023, 17 (13) : 1779 - 1788
  • [49] A multiple instance learning based framework for semantic image segmentation
    Gondra, Iker
    Xu, Tao
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2010, 48 (02) : 339 - 365
  • [50] A fast instance segmentation with one-stage multi-task deep neural network for autonomous driving
    Tseng, Kuo-Kun
    Lin, Jiangrui
    Chen, Chien-Ming
    Hassan, Mohammad Mehedi
    [J]. COMPUTERS & ELECTRICAL ENGINEERING, 2021, 93