DGM-VINS: Visual-Inertial SLAM for Complex Dynamic Environments With Joint Geometry Feature Extraction and Multiple Object Tracking

被引:17
作者
Song, Boyi [1 ]
Yuan, Xianfeng [1 ]
Ying, Zhongmou [1 ]
Yang, Baojiang [1 ]
Song, Yong [1 ]
Zhou, Fengyu [2 ]
机构
[1] Shandong Univ, Sch Mech Elect & Informat Engn, Weihai 264200, Peoples R China
[2] Shandong Univ, Sch Control Sci & Engn, Jinan 250100, Peoples R China
基金
中国国家自然科学基金;
关键词
Complex dynamic environments; joint geometric feature extraction; robustness and localization accuracy; temporal multiobject tracking; visual-inertial simultaneous localization and mapping (SLAM); ROBUST; VERSATILE; ACCURATE;
D O I
10.1109/TIM.2023.3280533
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Most current state-of-the-art simultaneous localization and mapping (SLAM) algorithms perform well in static environments. However, their applications in real-world scenarios are limited by the assumption that environments are static because their performance becomes unstable in complex dynamic environments. To enhance system stability and localization accuracy in complex dynamic scenes, this article presents a novel visual-inertial SLAM system called DGM-VINS. In DGM-VINS, a joint geometric dynamic feature extraction module (JGDFE) is designed, which can combine the advantages of multiple geometric constraints and effectively reduce the limitations of a single geometric constraint in the application process. In addition, a temporal instance segmentation module (TISM) is presented to establish the temporal correlation of instance objects in consecutive frames, which effectively addresses the instance segmentation issue in complex environments. The inertial measurement unit (IMU) is utilized for motion prediction and consistency detection to improve localization accuracy in challenging environments with weak textures. The proposed methodology is tested in various public datasets and actual scenarios, and the results demonstrate superior accuracy and robustness to existing methods in complex dynamic scenarios.
引用
收藏
页数:11
相关论文
共 39 条
  • [1] DOT: Dynamic Object Tracking for Visual SLAM
    Ballester, Irene
    Fontan, Alejandro
    Civera, Javier
    Strobl, Klaus H.
    Triebel, Rudolph
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 11705 - 11711
  • [2] Bârsan IA, 2018, IEEE INT CONF ROBOT, P7510
  • [3] DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM
    Bescos, Berta
    Campos, Carlos
    Tardos, Juan D.
    Neira, Jose
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) : 5191 - 5198
  • [4] DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes
    Bescos, Berta
    Facil, Jose M.
    Civera, Javier
    Neira, Jose
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04): : 4076 - 4083
  • [5] ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM
    Campos, Carlos
    Elvira, Richard
    Gomez Rodriguez, Juan J.
    Montiel, Jose M. M.
    Tardos, Juan D.
    [J]. IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) : 1874 - 1890
  • [6] A Real-Time Dynamic Object Segmentation Framework for SLAM System in Dynamic Scenes
    Chang, Jianfang
    Dong, Na
    Li, Donghui
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [7] SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information
    Cheng, Shuhong
    Sun, Changhe
    Zhang, Shijun
    Zhang, Dianfan
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [8] Online Multi-Object Tracking Using CNN-based Single Object Tracker with Spatial-Temporal Attention Mechanism
    Chu, Qi
    Ouyang, Wanli
    Li, Hongsheng
    Wang, Xiaogang
    Liu, Bin
    Yu, Nenghai
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4846 - 4855
  • [9] MonoSLAM: Real-time single camera SLAM
    Davison, Andrew J.
    Reid, Ian D.
    Molton, Nicholas D.
    Stasse, Olivier
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (06) : 1052 - 1067
  • [10] Direct Sparse Odometry
    Engel, Jakob
    Koltun, Vladlen
    Cremers, Daniel
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) : 611 - 625