Stereo SLAM in Dynamic Environments Using Semantic Segmentation

被引:2
|
作者
Ai, Yongbao [1 ]
Sun, Qianchong [1 ]
Xi, Zhipeng [1 ]
Li, Na [1 ]
Dong, Jianmeng [1 ]
Wang, Xiang [1 ]
机构
[1] Natl Innovat Inst Def Technol, Beijing 100071, Peoples R China
关键词
stereo SLAM; semantic segmentation; moving object detection; dynamic scenarios; SIMULTANEOUS LOCALIZATION; VISION;
D O I
10.3390/electronics12143112
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As we all know, many dynamic objects appear almost continuously in the real world that are immensely capable of impairing the performance of the majority of vision-based SLAM systems based on the static-world assumption. In order to improve the robustness and accuracy of visual SLAM in high-dynamic environments, a real-time and robust stereo SLAM system for dynamic scenes was proposed. To weaken the influence of dynamic content, the moving-object detection method was put forward in our visual odometry, and then the semantic segmentation network was combined in our stereo SLAM to extract pixel-level contours of dynamic objects. Then, the influences of dynamic objects were significantly weakened and the performance of our system increased markedly in dynamic, complex, and crowed city spaces. Following experiments with both the KITTI Odometry dataset and in a real-life scene, the results showed that our method could dramatically decrease the tracking error or drift, and improve the robustness and stability of our stereo SLAM in high dynamic outdoor scenarios.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] FCH-SLAM: A SLAM Method for Dynamic Environments using Semantic Segmentation
    Wang, Youwei, I
    Mikawa, Masahiko
    Fujisawa, Makoto
    2022 2ND INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB), 2022,
  • [2] The STDyn-SLAM: A Stereo Vision and Semantic Segmentation Approach for VSLAM in Dynamic Outdoor Environments
    Esparza, Daniela
    Flores, Gerardo
    IEEE ACCESS, 2022, 10 : 18201 - 18209
  • [3] Improving RGB-D SLAM in dynamic environments using semantic aided segmentation
    Kenye, Lhilo
    Kala, Rahul
    ROBOTICA, 2022, 40 (06) : 2065 - 2090
  • [4] KSF-SLAM: A Key Segmentation Frame Based Semantic SLAM in Dynamic Environments
    Yao Zhao
    Zhi Xiong
    Shuailin Zhou
    Zheng Peng
    Pascual Campoy
    Ling Zhang
    Journal of Intelligent & Robotic Systems, 2022, 105
  • [5] KSF-SLAM: A Key Segmentation Frame Based Semantic SLAM in Dynamic Environments
    Zhao, Yao
    Xiong, Zhi
    Zhou, Shuailin
    Peng, Zheng
    Campoy, Pascual
    Zhang, Ling
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2022, 105 (01)
  • [6] Semantic SLAM Based on Compensated Segmentation and Geometric Constraints in Dynamic Environments
    Fang, Baofu
    Zhou, Shuai
    Wang, Hao
    Proceedings of 2022 6th Asian Conference on Artificial Intelligence Technology, ACAIT 2022, 2022,
  • [7] A Semantic Segmentation Based Lidar SLAM System Towards Dynamic Environments
    Jian, Rui
    Su, Weihua
    Li, Ruihao
    Zhang, Shiyue
    Wei, Jiacheng
    Li, Boyang
    Huang, Ruqiang
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT III, 2019, 11742 : 582 - 590
  • [8] Semantic stereo visual SLAM toward outdoor dynamic environments based on ORB-SLAM2
    Li, Yawen
    Song, Guangming
    Hao, Shuang
    Mao, Juzheng
    Song, Aiguo
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2023, 50 (03): : 542 - 554
  • [9] DMS-SLAM: semantic visual SLAM based on deep mask segmentation in dynamic environments
    Gao, Shuyuan
    Zhang, Minhui
    Gao, Xicheng
    Zhang, Dawei
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (04)
  • [10] Blitz-SLAM: A semantic SLAM in dynamic environments
    Fan, Yingchun
    Zhang, Qichi
    Tang, Yuliang
    Liu, Shaofen
    Han, Hong
    PATTERN RECOGNITION, 2022, 121