Dynamic visual simultaneous localization and mapping based on semantic segmentation module

被引:7
作者
Jin, Jing [1 ,2 ,3 ]
Jiang, Xufeng [1 ,2 ,3 ]
Yu, Chenhui [1 ]
Zhao, Lingna [4 ]
Tang, Zhen [4 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Key Lab Ind Safety & Emergency Technol, Hefei 230009, Peoples R China
[3] Hefei Univ Technol, Intelligent Interconnected Syst Lab Anhui Prov, Hefei 230009, Peoples R China
[4] Anhui Water Conservancy Tech Coll, Sch Mechatron Engn, Hefei 231603, Peoples R China
关键词
Semantic SLAM; Dynamic scenes; Epipolar constraints; Point cloud map; MONOCULAR SLAM; ENVIRONMENTS; TRACKING;
D O I
10.1007/s10489-023-04531-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous localization and mapping (SLAM) is a key technique for mobile robotics. Moving objects can vastly impair the performance of a visual SLAM system. To deal with the problem, a new semantic visual SLAM system for indoor environments is proposed. Our system adds a semantic segmentation network and geometric model to detect and remove dynamic feature points on moving objects. Moreover, a 3D point cloud map with semantic information is created using semantic labels and depth images. We evaluate our method on the TUM RGB-D dataset and real-world environments. The evaluation metrics used are absolute trajectory error and relative position error. Experimental results show our method improves the accuracy in dynamic scenes compared to ORB-SLAM3 and other advanced methods.
引用
收藏
页码:19418 / 19432
页数:15
相关论文
共 50 条
  • [31] Review of vision-based Simultaneous Localization and Mapping
    Li, Ang
    Ruan, Xiaogang
    Huang, Jing
    Zhu, Xiaoqing
    Wang, Fei
    [J]. PROCEEDINGS OF 2019 IEEE 3RD INFORMATION TECHNOLOGY, NETWORKING, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (ITNEC 2019), 2019, : 117 - 123
  • [32] PSMD-SLAM: Panoptic Segmentation-Aided Multi-Sensor Fusion Simultaneous Localization and Mapping in Dynamic Scenes
    Song, Chengqun
    Zeng, Bo
    Cheng, Jun
    Wu, Fuxiang
    Hao, Fusheng
    [J]. APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [33] Simultaneous Localization and Mapping in the Epoch of Semantics: A Survey
    Sualeh, Muhammad
    Kim, Gon-Woo
    [J]. INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2019, 17 (03) : 729 - 742
  • [34] Dynamic SLAM Visual Odometry Based on Instance Segmentation: A Comprehensive Review
    Peng, Jiansheng
    Yang, Qing
    Chen, Dunhua
    Yang, Chengjun
    Xu, Yong
    Qin, Yong
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2024, 78 (01): : 167 - 196
  • [35] Feature Based Simultaneous Localization And Semi-Dense Mapping With Monocular Camera
    Xu, Xiansong
    Fan, Hanqi
    [J]. 2016 9TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, BIOMEDICAL ENGINEERING AND INFORMATICS (CISP-BMEI 2016), 2016, : 17 - 22
  • [36] Visual Simultaneous Localization and Mapping for Sewer Pipe Networks Leveraging Cylindrical Regularity
    Zhang, Rui
    Worley, Rob
    Edwards, Sarah
    Aitken, Jonathan
    Anderson, Sean R. R.
    Mihaylova, Lyudmila
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3406 - 3413
  • [37] Sharing visual-inertial data for collaborative decentralized simultaneous localization and mapping
    Dubois, Rodolphe
    Eudes, Alexandre
    Fremont, Vincent
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2022, 148
  • [38] The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detection
    Tsintotas, Konstantinos A.
    Bampis, Loukas
    Gasteratos, Antonios
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) : 19929 - 19953
  • [39] Deep learning-based 6-DoF visual relocalization assisted simultaneous localization and mapping (SLAM)
    Wang, Shuo
    Li, Xin
    Zhang, Yu
    Ma, Songhui
    Ren, Xianrui
    [J]. INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2025,
  • [40] Monocular SLAM System in Dynamic Scenes Based on Semantic Segmentation
    Sheng, Chao
    Pan, Shuguo
    Zeng, Pan
    Huang, Lixiao
    Zhao, Tao
    [J]. IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 593 - 603