Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:7
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
  • [21] UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes
    Liu, Jun
    Dong, Junyuan
    Hu, Mingming
    Lu, Xu
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02): : 206 - 218
  • [22] Optimized segmentation with image inpainting for semantic mapping in dynamic scenes
    Zhang, Jianfeng
    Liu, Yang
    Guo, Chi
    Zhan, Jiao
    APPLIED INTELLIGENCE, 2023, 53 (02) : 2173 - 2188
  • [23] Enhanced Simultaneous Localization and Mapping Algorithm Based on Deep Learning for Highly Dynamic Environment
    Lu, Yin
    Wang, Haibo
    Sun, Jin
    Zhang, J. Andrew
    SENSORS, 2025, 25 (08)
  • [24] DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments
    Gao, Shuyuan
    Zhang, Minhui
    Gao, Xicheng
    Zhang, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
  • [25] Fusing Semantic Segmentation and Object Detection for Visual SLAM in Dynamic Scenes
    Yu, Peilin
    Guo, Chi
    Liu, Yang
    Zhang, Huyin
    PROCEEDINGS OF 27TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2021, 2021,
  • [26] A Semantics-Guided Visual Simultaneous Localization and Mapping with U-Net for Complex Dynamic Indoor Environments
    Zeng, Zhi
    Lin, Hui
    Kang, Zhizhong
    Xie, Xiaokui
    Yang, Juntao
    Li, Chuyu
    Zhu, Longze
    REMOTE SENSING, 2023, 15 (23)
  • [27] A Model-based Simultaneous Localization and Mapping Approach for Deformable Bodies
    Schuele, Johannes
    Haag, Jonathan
    Somers, Peter
    Veil, Carina
    Tarin, Christina
    Sawodny, Oliver
    2022 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2022, : 607 - 612
  • [28] Online simultaneous localization and mapping with parallelization for dynamic line segments based on moving horizon estimation
    Muhammad, Haziq
    Ishikawa, Yasumasa
    Sekiguchi, Kazuma
    Nonaka, Kenichiro
    ARTIFICIAL LIFE AND ROBOTICS, 2024, 29 (02) : 311 - 325
  • [29] Dynamic Scene Semantics SLAM Based on Semantic Segmentation
    Han, Shuangquan
    Xi, Zhihong
    IEEE ACCESS, 2020, 8 : 43563 - 43570
  • [30] Improving Visual Localization Accuracy in Dynamic Environments Based on Dynamic Region Removal
    Cheng, Jiyu
    Zhang, Hong
    Meng, Max Q. -H.
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) : 1585 - 1596