DYS-SLAM: A real-time RGBD SLAM combined with optical flow and semantic information in a dynamic environment

被引:3
|
作者
Fang, Yuhua [1 ]
Xie, Zhijun [1 ]
Chen, Kewei [2 ]
Huang, Guangyan [3 ]
Zarei, Roozbeh [3 ]
Xie, Yuntao [4 ]
机构
[1] Ningbo Univ, Sch Fac Elect Engn & Comp Sci, Ningbo, Peoples R China
[2] Ningbo Univ, Sch Fac Mech Engn & Mech, Ningbo, Peoples R China
[3] Deakin Univ, Sch Informat Technol, Melbourne, Vic, Australia
[4] Univ New South Wales, Sch Comp Sci & Engn, Sydney, NSW, Australia
基金
中国国家自然科学基金;
关键词
Visual SLAM; object detection; dynamic environment; deep learning for visual perception; SIMULTANEOUS LOCALIZATION;
D O I
10.3233/JIFS-234235
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Traditional Simultaneous Localization and Mapping application in dynamic situations is constrained by static assumptions. However, the majority of well-known dynamic SLAM systems use deep learning to identify dynamic objects, which creates the issue of trade-offs between accuracy and real-time. To tackle this issue, this work suggests a unique dynamic semantics method(DYS-SLAM) for semantic simultaneous localization and mapping that strikes a trade-off between high accuracy and high real-time performance. We propose M-LK, an enhanced Lucas-Kanade(LK) optical flow method. This technique keeps the continuous motion and greyscale consistency assumptions from the original method while switching out the spatial consistency assumption for a motion consistency assumption, reducing sensitivity to image gradients to identify dynamic feature points and regions efficiently. In order to increase segmentation accuracy while maintaining real-time performance, we develop a segmentation refinement scheme that projects 3D point cloud segmentation results into 2D object detection zones. A dense semantic octree graph is built in the interim to expedite the high-level process. Compared to the four equivalent dynamic SLAM approaches, experiments on the publicly available TUM RGB-D dataset demonstrate that the DYS-SLAM method offers competitive localization accuracy and satisfactory real-time performance in both high and low-dynamic scenarios.
引用
收藏
页码:10349 / 10367
页数:19
相关论文
共 50 条
  • [41] A Real-Time Dynamic Object Segmentation Framework for SLAM System in Dynamic Scenes
    Chang, Jianfang
    Dong, Na
    Li, Donghui
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [42] RED-SLAM: real-time and effective RGB-D SLAM with spatial-geometric observations and fast semantic perception for dynamic environments
    Liu, Hailin
    Tian, Lianfang
    Du, Qiliang
    Duan, Ruxiang
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2025, 36 (03)
  • [43] Improved Real-Time Monocular SLAM Using Semantic Segmentation on Selective Frames
    Lee, Jinkyu
    Back, Muhyun
    Hwang, Sung Soo
    Chun, Il Yong
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (03) : 2800 - 2813
  • [44] Efficient Real-Time Localization in Prior Indoor Maps Using Semantic SLAM
    Goswami, R. G.
    Amith, P. V.
    Hari, J.
    Dhaygude, A.
    Krishnamurthy, P.
    Rizzo, J.
    Tzes, A.
    Khorrami, F.
    2023 9TH INTERNATIONAL CONFERENCE ON AUTOMATION, ROBOTICS AND APPLICATIONS, ICARA, 2023, : 299 - 303
  • [45] RGB-D SLAM Algorithm Based on Delayed Semantic Information in Dynamic Environment
    Wang H.
    Zhou S.
    Fang B.
    Moshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence, 2023, 36 (10): : 953 - 966
  • [46] CFP-SLAM: A Real-time Visual SLAM Based on Coarse-to-Fine Probability in Dynamic Environments
    Hu, Xinggang
    Zhang, Yunzhou
    Cao, Zhenzhong
    Ma, Rong
    Wu, Yanmin
    Deng, Zhiqiang
    Sun, Wenkai
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4399 - 4406
  • [47] Strong-SLAM: real-time RGB-D visual SLAM in dynamic environments based on StrongSORT
    Huang, Wei
    Zou, Chunlong
    Yun, Juntong
    Jiang, Du
    Huang, Li
    Liu, Ying
    Jiang, Guo Zhang
    Xie, Yuanmin
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (12)
  • [48] SP-Flow: Self-supervised optical flow correspondence point prediction for real-time SLAM
    Qin, Zixuan
    Yin, Mengxiao
    Li, Guiqing
    Yang, Feng
    COMPUTER AIDED GEOMETRIC DESIGN, 2020, 82
  • [49] DRO-SLAM: real-time object-aware SLAM for navigation robots and autonomous driving in dynamic environments
    Wang Zixian
    Zhang Miao
    Yan Danfeng
    The Journal of China Universities of Posts and Telecommunications, 2023, 30 (03) : 14 - 24
  • [50] DRO-SLAM: real-time object-aware SLAM for navigation robots and autonomous driving in dynamic environments
    Zixian W.
    Miao Z.
    Danfeng Y.
    Journal of China Universities of Posts and Telecommunications, 2023, 30 (03): : 14 - 24