Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:9
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
[21]   Graph-based Simultaneous Localization and Mapping with incorporated dynamic object motion [J].
Aerts, Peter ;
Slaets, Peter ;
Demeester, Eric .
2023 EUROPEAN CONFERENCE ON MOBILE ROBOTS, ECMR, 2023, :151-157
[22]   Vehicle Visual SLAM in Dynamic Scenes Based on Semantic Segmentation and Motion Consistency Constraints [J].
Huang S. ;
Hu M. ;
Zhou Y. ;
Yin Z. ;
Qin X. ;
Bian Y. ;
Jia Q. .
Qiche Gongcheng/Automotive Engineering, 2022, 44 (10) :1503-1510
[23]   Optimized segmentation with image inpainting for semantic mapping in dynamic scenes [J].
Jianfeng Zhang ;
Yang Liu ;
Chi Guo ;
Jiao Zhan .
Applied Intelligence, 2023, 53 :2173-2188
[24]   UDS-SLAM: real-time robust visual SLAM based on semantic segmentation in dynamic scenes [J].
Liu, Jun ;
Dong, Junyuan ;
Hu, Mingming ;
Lu, Xu .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2024, 51 (02) :206-218
[25]   Optimized segmentation with image inpainting for semantic mapping in dynamic scenes [J].
Zhang, Jianfeng ;
Liu, Yang ;
Guo, Chi ;
Zhan, Jiao .
APPLIED INTELLIGENCE, 2023, 53 (02) :2173-2188
[26]   Enhanced Simultaneous Localization and Mapping Algorithm Based on Deep Learning for Highly Dynamic Environment [J].
Lu, Yin ;
Wang, Haibo ;
Sun, Jin ;
Zhang, J. Andrew .
SENSORS, 2025, 25 (08)
[27]   DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments [J].
Gao, Shuyuan ;
Zhang, Minhui ;
Gao, Xicheng ;
Zhang, Dawei .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
[28]   Fusing Semantic Segmentation and Object Detection for Visual SLAM in Dynamic Scenes [J].
Yu, Peilin ;
Guo, Chi ;
Liu, Yang ;
Zhang, Huyin .
PROCEEDINGS OF 27TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2021, 2021,
[29]   A Semantics-Guided Visual Simultaneous Localization and Mapping with U-Net for Complex Dynamic Indoor Environments [J].
Zeng, Zhi ;
Lin, Hui ;
Kang, Zhizhong ;
Xie, Xiaokui ;
Yang, Juntao ;
Li, Chuyu ;
Zhu, Longze .
REMOTE SENSING, 2023, 15 (23)
[30]   A Model-based Simultaneous Localization and Mapping Approach for Deformable Bodies [J].
Schuele, Johannes ;
Haag, Jonathan ;
Somers, Peter ;
Veil, Carina ;
Tarin, Christina ;
Sawodny, Oliver .
2022 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2022, :607-612