DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment

被引:3
作者
Fang, Yuhua [1 ]
Xie, Zhijun [1 ]
Chen, Kewei [2 ]
Huang, Guangyan [3 ]
Zarei, Roozbeh [3 ]
Xie, Yuntao [4 ]
机构
[1] Ningbo Univ, Sch Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[2] Ningbo Univ, Sch Fac Mech Engn & Mech, Ningbo, Peoples R China
[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Visual SLAM; object detection; dynamic environment; deep learning for visual perception; SIMULTANEOUS LOCALIZATION;
D O I
10.3233/JIFS-234235
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional Simultaneous Localization and Mapping application in dynamic situations is constrained by static assumptions. However, the majority of well-known dynamic SLAM systems use deep learning to identify dynamic objects, which creates the issue of trade-offs between accuracy and real-time. To tackle this issue, this work suggests a unique dynamic semantics method(DYS-SLAM) for semantic simultaneous localization and mapping that strikes a trade-off between high accuracy and high real-time performance. We propose M-LK, an enhanced Lucas-Kanade(LK) optical flow method. This technique keeps the continuous motion and greyscale consistency assumptions from the original method while switching out the spatial consistency assumption for a motion consistency assumption, reducing sensitivity to image gradients to identify dynamic feature points and regions efficiently. In order to increase segmentation accuracy while maintaining real-time performance, we develop a segmentation refinement scheme that projects 3D point cloud segmentation results into 2D object detection zones. A dense semantic octree graph is built in the interim to expedite the high-level process. Compared to the four equivalent dynamic SLAM approaches, experiments on the publicly available TUM RGB-D dataset demonstrate that the DYS-SLAM method offers competitive localization accuracy and satisfactory real-time performance in both high and low-dynamic scenarios.
引用
收藏
页码:10349 / 10367
页数:19
相关论文
共 32 条
  • [21] PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume
    Sun, Deqing
    Yang, Xiaodong
    Liu, Ming-Yu
    Kautz, Jan
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 8934 - 8943
  • [22] Tan W, 2013, INT SYM MIX AUGMENT, P209, DOI 10.1109/ISMAR.2013.6671781
  • [23] Wadud R. A., 2022, arXiv
  • [24] Wang H, 2022, Arxiv, DOI arXiv:2205.04300
  • [25] Online simultaneous localization and mapping in dynamic environments
    Wolf, D
    Sukhatme, GS
    [J]. 2004 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION, VOLS 1- 5, PROCEEDINGS, 2004, : 1301 - 1307
  • [26] YOLO-SLAM: A semantic SLAM system towards dynamic environment with geometric constraint
    Wu, Wenxin
    Guo, Liang
    Gao, Hongli
    You, Zhichao
    Liu, Yuekai
    Chen, Zhiqiang
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (08) : 6011 - 6026
  • [27] DGS-SLAM: A Fast and Robust RGBD SLAM in Dynamic Environments Combined by Geometric and Semantic Information
    Yan, Li
    Hu, Xiao
    Zhao, Leyang
    Chen, Yu
    Wei, Pengcheng
    Xie, Hong
    [J]. REMOTE SENSING, 2022, 14 (03)
  • [28] MGC-VSLAM: A Meshing-Based and Geometric Constraint VSLAM for Dynamic Indoor Environments
    Yang, Shiqiang
    Fan, Guohao
    Bai, Lele
    Li, Rui
    Li, Dexin
    [J]. IEEE ACCESS, 2020, 8 (08): : 81007 - 81021
  • [29] Yi Zhang, 2020, 2020 4th Annual International Conference on Data Science and Business Analytics (ICDSBA), P324, DOI 10.1109/ICDSBA51020.2020.00090
  • [30] Yu C, 2018, IEEE INT C INT ROBOT, P1168, DOI 10.1109/IROS.2018.8593691