Semantic Loopback Detection Method Based on Instance Segmentation and Visual SLAM in Autonomous Driving

被引:2
|
作者
Huang, Li [1 ]
Zhu, Zhe [1 ]
Yun, Juntong [2 ,3 ,4 ]
Xu, Manman [2 ,3 ,4 ]
Liu, Ying [2 ,4 ]
Sun, Ying [2 ,3 ,4 ]
Hu, Jun [2 ,3 ,4 ]
Li, Fazeng [2 ,3 ,4 ]
机构
[1] Wuhan Univ Sci & Technol, Coll Comp Sci & Technol, Hubei Prov Key Lab Intelligent Informat Proc & Rea, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Precis Mfg Res Inst, Res Ctr Biomimet Robot & Intelligent Measurement &, Key Lab Met Equipment & Control Technol,Minist Edu, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] Hubei Longzhong Lab, Xiangyang 441000, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual SLAM; image segmentation; semantic information; data association; loopback detection; autonomous driving; IMAGE; PERCEPTION;
D O I
10.1109/TITS.2023.3315231
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Autonomous driving has gradually become a research hotspot in recent years, but the robustness of loopback detection in complex environments such as dynamic and weak textures needs to be improved. A semantic loopback detection method is proposed based on instance segmentation and visual SLAM to make sufficient use of semantic information in autonomous driving. The proposed method combines image segmentation and visual SLAM (Simultaneous Localization and Mapping) to construct a semantic SLAM system. What's more, a data association method that combines semantic and geometric information is proposed to improve the traditional loopback detection method by using semantic information to increase the accuracy of loopback detection. The result of experiment on the TUM public dataset shows that the loopback detection accuracy of the improved loopback detection method is higher than that of the bag-of-words method in all four datasets, and our proposed algorithm can effectively improve the accuracy of loopback detection of the SLAM system in general.
引用
收藏
页码:3118 / 3127
页数:10
相关论文
共 50 条
  • [21] SIIS-SLAM: A Vision SLAM Based on Sequential Image Instance Segmentation
    Lv, Kefeng
    Zhang, Yongsheng
    Yu, Ying
    Wang, Ziquan
    Min, Jie
    IEEE ACCESS, 2023, 11 : 17430 - 17440
  • [22] A novel multi-exposure fusion approach for enhancing visual semantic segmentation of autonomous driving
    Huang, Tengchao
    Song, Shuang
    Liu, Qianjie
    He, Wei
    Zhu, Qingyuan
    Hu, Huosheng
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 2023, 237 (07) : 1652 - 1667
  • [23] Instance Segmentation Model Evaluation and Rapid Deployment for Autonomous Driving Using Domain Differences
    Guan, Licong
    Yuan, Xue
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) : 4050 - 4059
  • [24] Improved Visual SLAM Using Semantic Segmentation and Layout Estimation
    Mahmoud, Ahmed
    Atia, Mohamed
    ROBOTICS, 2022, 11 (05)
  • [25] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [26] Segmentation of Road Negative Obstacles Based on Dual Semantic-Feature Complementary Fusion for Autonomous Driving
    Feng, Zhen
    Guo, Yanning
    Sun, Yuxiang
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (04): : 4687 - 4697
  • [27] Multimodal Semantic Segmentation in Autonomous Driving: A Review of Current Approaches and Future Perspectives
    Rizzoli, Giulia
    Barbato, Francesco
    Zanuttigh, Pietro
    TECHNOLOGIES, 2022, 10 (04)
  • [28] FCH-SLAM: A SLAM Method for Dynamic Environments using Semantic Segmentation
    Wang, Youwei, I
    Mikawa, Masahiko
    Fujisawa, Makoto
    2022 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB), 2022,
  • [29] Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
    Yao, Shanliang
    Guan, Runwei
    Huang, Xiaoyu
    Li, Zhuoxiao
    Sha, Xiangyu
    Yue, Yong
    Lim, Eng Gee
    Seo, Hyungjoon
    Man, Ka Lok
    Zhu, Xiaohui
    Yue, Yutao
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2024, 9 (01): : 2094 - 2128
  • [30] Semantic Segmentation of Road Profiles for Efficient Sensing in Autonomous Driving
    Cheng, Guo
    Zheng, Jiang Yu
    Kilicarslan, Mehmet
    2019 30TH IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV19), 2019, : 564 - 569