Stereo SLAM in Dynamic Environments Using Semantic Segmentation

被引:2
|
作者
Ai, Yongbao [1 ]
Sun, Qianchong [1 ]
Xi, Zhipeng [1 ]
Li, Na [1 ]
Dong, Jianmeng [1 ]
Wang, Xiang [1 ]
机构
[1] Natl Innovat Inst Def Technol, Beijing 100071, Peoples R China
关键词
stereo SLAM; semantic segmentation; moving object detection; dynamic scenarios; SIMULTANEOUS LOCALIZATION; VISION;
D O I
10.3390/electronics12143112
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As we all know, many dynamic objects appear almost continuously in the real world that are immensely capable of impairing the performance of the majority of vision-based SLAM systems based on the static-world assumption. In order to improve the robustness and accuracy of visual SLAM in high-dynamic environments, a real-time and robust stereo SLAM system for dynamic scenes was proposed. To weaken the influence of dynamic content, the moving-object detection method was put forward in our visual odometry, and then the semantic segmentation network was combined in our stereo SLAM to extract pixel-level contours of dynamic objects. Then, the influences of dynamic objects were significantly weakened and the performance of our system increased markedly in dynamic, complex, and crowed city spaces. Following experiments with both the KITTI Odometry dataset and in a real-life scene, the results showed that our method could dramatically decrease the tracking error or drift, and improve the robustness and stability of our stereo SLAM in high dynamic outdoor scenarios.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Object measurement in real underwater environments using improved stereo matching with semantic segmentation
    Zhang, Jiawei
    Han, Fenglei
    Han, Duanfeng
    Su, Zhihao
    Li, Hansheng
    Zhao, Wangyuan
    Yang, Jianfeng
    MEASUREMENT, 2023, 218
  • [32] ADS-SLAM: a semantic SLAM based on adaptive motion compensation and semantic information for dynamic environments
    Dai, Jun
    Yang, Minghao
    Li, Yanqin
    Zhao, Junwei
    Hanajima, Naohiko
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (01)
  • [33] RVD-SLAM: A Real-Time Visual SLAM Toward Dynamic Environments Based on Sparsely Semantic Segmentation and Outlier Prior
    Zhou, Yao
    Tao, Fazhan
    Fu, Zhumu
    Zhu, Longlong
    Ma, Haoxiang
    IEEE SENSORS JOURNAL, 2023, 23 (24) : 30773 - 30785
  • [34] PFD-SLAM: A New RGB-D SLAM for Dynamic Indoor Environments Based on Non-Prior Semantic Segmentation
    Zhang, Chenyang
    Zhang, Rongchun
    Jin, Sheng
    Yi, Xuefeng
    REMOTE SENSING, 2022, 14 (10)
  • [35] Monocular SLAM System in Dynamic Scenes Based on Semantic Segmentation
    Sheng, Chao
    Pan, Shuguo
    Zeng, Pan
    Huang, Lixiao
    Zhao, Tao
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 593 - 603
  • [36] Dynamic dense CRF inference for video segmentation and semantic SLAM
    You, Mingyu
    Luo, Chaoxian
    Zhou, Hongjun
    Zhu, Shaoqing
    PATTERN RECOGNITION, 2023, 133
  • [37] Visual Odometry in Dynamic Environments using Light Weight Semantic Segmentation
    Tan Ai, Richard Josiah C.
    Ligutan, Dino Dominic F.
    Brillantes, Allysa Kate M.
    Espanola, Jason L.
    Dadios, Elmer P.
    2019 IEEE 11TH INTERNATIONAL CONFERENCE ON HUMANOID, NANOTECHNOLOGY, INFORMATION TECHNOLOGY, COMMUNICATION AND CONTROL, ENVIRONMENT, AND MANAGEMENT (HNICEM), 2019,
  • [38] Robust RGB-D SLAM in Dynamic Environments using Geometry and Semantic Information
    Xiao, Yao
    Zou, Junjie
    Jin, Ronghe
    Mei, Tiancan
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON CONTROL & AUTOMATION, ICCA 2024, 2024, : 731 - 736
  • [39] LRD-SLAM: A Lightweight Robust Dynamic SLAM Method by Semantic Segmentation Network
    Jia, Shifeng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022
  • [40] A Semantic SLAM System for Catadioptric Panoramic Cameras in Dynamic Environments
    Zhang, Yu
    Xu, Xiping
    Zhang, Ning
    Lv, Yaowen
    SENSORS, 2021, 21 (17)