Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:9
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
[41]   Sharing visual-inertial data for collaborative decentralized simultaneous localization and mapping [J].
Dubois, Rodolphe ;
Eudes, Alexandre ;
Fremont, Vincent .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 148
[42]   The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection [J].
Tsintotas, Konstantinos A. ;
Bampis, Loukas ;
Gasteratos, Antonios .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :19929-19953
[43]   Deep learning-based 6-DoF visual relocalization assisted simultaneous localization and mapping (SLAM) [J].
Wang, Shuo ;
Li, Xin ;
Zhang, Yu ;
Ma, Songhui ;
Ren, Xianrui .
INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025,
[44]   Monocular SLAM System in Dynamic Scenes Based on Semantic Segmentation [J].
Sheng, Chao ;
Pan, Shuguo ;
Zeng, Pan ;
Huang, Lixiao ;
Zhao, Tao .
IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 :593-603
[45]   A Robust Approach for a Filter-Based Monocular Simultaneous Localization and Mapping (SLAM) System [J].
Munguia, Rodrigo ;
Castillo-Toledo, Bernardino ;
Grau, Antoni .
SENSORS, 2013, 13 (07) :8501-8522
[46]   SLAM2: Simultaneous Localization and Multimode Mapping for indoor dynamic environments [J].
Lin, Zhihao ;
Zhang, Qi ;
Tian, Zhen ;
Yu, Peizhuo ;
Ye, Ziyang ;
Zhuang, Hanyang ;
Lan, Jianglin .
PATTERN RECOGNITION, 2025, 158
[47]   Simultaneous Localization and Mapping in Multipath Environments [J].
Gentner, Christian ;
Ma, Boxiao ;
Ulmschneider, Markus ;
Jost, Thomas ;
Dammann, Armin .
PROCEEDINGS OF THE 2016 IEEE/ION POSITION, LOCATION AND NAVIGATION SYMPOSIUM (PLANS), 2016, :807-815
[48]   Simultaneous localization and mapping for autonomous bicycles [J].
Stasinopoulos, Sotirios ;
Zhao, Mingguo ;
Zhong, Yisheng .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2017, 14 (03)
[49]   DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments [J].
Ji, Qiang ;
Zhang, Zikang ;
Chen, Yifu ;
Zheng, Enhui .
IEEE ACCESS, 2024, 12 :43827-43837
[50]   Semantic visual SLAM in dynamic environment [J].
Shuhuan Wen ;
Pengjiang Li ;
Yongjie Zhao ;
Hong Zhang ;
Fuchun Sun ;
Zhe Wang .
Autonomous Robots, 2021, 45 :493-504