DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment

被引:3
作者
Fang, Yuhua [1 ]
Xie, Zhijun [1 ]
Chen, Kewei [2 ]
Huang, Guangyan [3 ]
Zarei, Roozbeh [3 ]
Xie, Yuntao [4 ]
机构
[1] Ningbo Univ, Sch Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[2] Ningbo Univ, Sch Fac Mech Engn & Mech, Ningbo, Peoples R China
[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Visual SLAM; object detection; dynamic environment; deep learning for visual perception; SIMULTANEOUS LOCALIZATION;
D O I
10.3233/JIFS-234235
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional Simultaneous Localization and Mapping application in dynamic situations is constrained by static assumptions. However, the majority of well-known dynamic SLAM systems use deep learning to identify dynamic objects, which creates the issue of trade-offs between accuracy and real-time. To tackle this issue, this work suggests a unique dynamic semantics method(DYS-SLAM) for semantic simultaneous localization and mapping that strikes a trade-off between high accuracy and high real-time performance. We propose M-LK, an enhanced Lucas-Kanade(LK) optical flow method. This technique keeps the continuous motion and greyscale consistency assumptions from the original method while switching out the spatial consistency assumption for a motion consistency assumption, reducing sensitivity to image gradients to identify dynamic feature points and regions efficiently. In order to increase segmentation accuracy while maintaining real-time performance, we develop a segmentation refinement scheme that projects 3D point cloud segmentation results into 2D object detection zones. A dense semantic octree graph is built in the interim to expedite the high-level process. Compared to the four equivalent dynamic SLAM approaches, experiments on the publicly available TUM RGB-D dataset demonstrate that the DYS-SLAM method offers competitive localization accuracy and satisfactory real-time performance in both high and low-dynamic scenarios.
引用
收藏
页码:10349 / 10367
页数:19
相关论文
共 32 条
  • [1] Stereo camera visual SLAM with hierarchical masking and motion-state classification at outdoor construction sites containing large dynamic objects
    Bao, Runqiu
    Komatsu, Ren
    Miyagusuku, Renato
    Chino, Masaki
    Yamashita, Atsushi
    Asama, Hajime
    [J]. ADVANCED ROBOTICS, 2021, 35 (3-4) : 228 - 241
  • [2] DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes
    Bescos, Berta
    Facil, Jose M.
    Civera, Javier
    Neira, Jose
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 4076 - 4083
  • [3] Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age
    Cadena, Cesar
    Carlone, Luca
    Carrillo, Henry
    Latif, Yasir
    Scaramuzza, Davide
    Neira, Jose
    Reid, Ian
    Leonard, John J.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2016, 32 (06) : 1309 - 1332
  • [4] Robust Visual Localization in Dynamic Environments Based on Sparse Motion Removal
    Cheng, Jiyu
    Wang, Chaoqun
    Meng, Max Q-H
    [J]. IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (02) : 658 - 669
  • [5] DM-SLAM: A Feature-Based SLAM System for Rigid Dynamic Scenes
    Cheng, Junhao
    Wang, Zhi
    Zhou, Hongyan
    Li, Li
    Yao, Jian
    [J]. ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2020, 9 (04)
  • [6] Chenhao Zhao, 2021, 2021 China Automation Congress (CAC), P1920, DOI 10.1109/CAC53003.2021.9727736
  • [7] RGB-D SLAM in Dynamic Environments Using Point Correlations
    Dai, Weichen
    Zhang, Yu
    Li, Ping
    Fang, Zheng
    Scherer, Sebastian
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) : 373 - 389
  • [8] Direct Sparse Odometry
    Engel, Jakob
    Koltun, Vladlen
    Cremers, Daniel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) : 611 - 625
  • [9] Semantic SLAM With More Accurate Point Cloud Map in Dynamic Environments
    Fan, Yingchun
    Zhang, Qichi
    Liu, Shaofeng
    Tang, Yuliang
    Jing, Xin
    Yao, Jintao
    Han, Hong
    [J]. IEEE ACCESS, 2020, 8 : 112237 - 112252
  • [10] Garg S, 2021, Arxiv, DOI arXiv:2101.00443