DRV-SLAM: An Adaptive Real-Time Semantic Visual SLAM Based on Instance Segmentation Toward Dynamic Environments

被引:8
作者
Ji, Qiang [1 ]
Zhang, Zikang [1 ]
Chen, Yifu [1 ]
Zheng, Enhui [1 ]
机构
[1] China Jiliang Univ, Sch Mech & Elect Engn, Hangzhou 310018, Peoples R China
关键词
Visual simultaneous localization and mapping (SLAM); dynamic environment; motion states; mapping; TRACKING;
D O I
10.1109/ACCESS.2024.3379269
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional simultaneous localization and mapping (SLAM) methodologies predominantly rely on the assumption of a static environment. This constraint limits the applicability of most visual SLAM systems in various real-world scenarios. In this paper, we introduce a real-time semantic visual SLAM algorithm tailored for complex dynamic environments (DRV-SLAM). DRV-SLAM leverages image analysis to identify potential moving objects and determine their current motion states. By dynamically adjusting the rejection of unreliable dynamic feature points based on the proportion of potential moving objects in the environment, DRV-SLAM significantly enhances the system's localization accuracy and robustness in complex dynamic environments. Additionally, DRV-SLAM employs a dense mapping approach that combines global downsampling and targeted object data enhancement. This method effectively reduces the memory footprint of dense point cloud maps, enabling DRV-SLAM to efficiently construct large-scale dense point cloud maps in diverse scenarios. Experimental results show that in a highly dynamic environment, the DRV-SLAM algorithm shows an order of magnitude performance improvement compared to the traditional ORB-SLAM2 algorithm. The performance index of absolute trajectory error is significantly improved by more than 98%, and DRV-SLAM is currently one of the most real-time, accurate and robust systems for dynamic scenes.
引用
收藏
页码:43827 / 43837
页数:11
相关论文
共 39 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   DOT: Dynamic Object Tracking for Visual SLAM [J].
Ballester, Irene ;
Fontan, Alejandro ;
Civera, Javier ;
Strobl, Klaus H. ;
Triebel, Rudolph .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, :11705-11711
[3]   DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM [J].
Bescos, Berta ;
Campos, Carlos ;
Tardos, Juan D. ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) :5191-5198
[4]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[5]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[6]   SG-SLAM: A Real-Time RGB-D Visual SLAM Toward Dynamic Scenes With Semantic and Geometric Information [J].
Cheng, Shuhong ;
Sun, Changhe ;
Zhang, Shijun ;
Zhang, Dianfan .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[7]   SOF-SLAM: A Semantic Visual SLAM for Dynamic Environments [J].
Cui, Linyan ;
Ma, Chaowei .
IEEE ACCESS, 2019, 7 :166528-166539
[8]   An Adaptive SVSF-SLAM Algorithm in Dynamic Environment for Cooperative Unmanned Vehicles [J].
Demim, Fethi ;
Boucheloukh, Abdelghani ;
Nemra, Abdelkrim ;
Kobzili, Elhaouari ;
Hamerlain, Mustapha ;
Bazoula, Abdelouahab .
IFAC PAPERSONLINE, 2019, 52 (15) :394-399
[9]   LSD-SLAM: Large-Scale Direct Monocular SLAM [J].
Engel, Jakob ;
Schoeps, Thomas ;
Cremers, Daniel .
COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 :834-849
[10]   RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY [J].
FISCHLER, MA ;
BOLLES, RC .
COMMUNICATIONS OF THE ACM, 1981, 24 (06) :381-395