Visual SLAM Mapping Based on YOLOv5 in Dynamic Scenes

被引:17
作者
Zhang, Xinguang [1 ]
Zhang, Ruidong [1 ]
Wang, Xiankun [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Mech & Automot Engn, Shanghai 201620, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 22期
关键词
dynamic SLAM; YOLOv5; network; deep learning; OBJECT DETECTION; ALGORITHM; ORB;
D O I
10.3390/app122211548
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
When building a map of a dynamic environment, simultaneous localization and mapping systems have problems such as poor robustness and inaccurate pose estimation. This paper proposes a new mapping method based on the ORB-SLAM2 algorithm combined with the YOLOv5 network. First, the YOLOv5 network of the tracing thread is used to detect dynamic objects of each frame, and to get keyframes with detection of dynamic information. Second, the dynamic objects of each image frame are detected using the YOLOv5 network, and the detected dynamic points are rejected. Finally, the global map is constructed using the keyframes after eliminating the highly dynamic objects. The test results using the TUM dataset show that when the map is constructed in a dynamic environment, compared with the ORB-SLAM2 algorithm, the absolute trajectory error of our algorithm is reduced by 97.8%, and the relative positional error is reduced by 59.7%. The average time consumed to track each image frame is improved by 94.7% compared to DynaSLAM. In terms of algorithmic real-time performance, this paper's algorithm is significantly better than the comparable dynamic SLAM map-building algorithm DynaSLAM.
引用
收藏
页数:22
相关论文
共 36 条
[1]   Role of Deep Learning in Loop Closure Detection for Visual and Lidar SLAM: A Survey [J].
Arshad, Saba ;
Kim, Gon-Woo .
SENSORS, 2021, 21 (04) :1-17
[2]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[3]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[4]   Horticultural Image Feature Matching Algorithm Based on Improved ORB and LK Optical Flow [J].
Chen, Qinhan ;
Yao, Lijian ;
Xu, Lijun ;
Yang, Yankun ;
Xu, Taotao ;
Yang, Yuncong ;
Liu, Yu .
REMOTE SENSING, 2022, 14 (18)
[5]   SOF-SLAM: A Semantic Visual SLAM for Dynamic Environments [J].
Cui, Linyan ;
Ma, Chaowei .
IEEE ACCESS, 2019, 7 :166528-166539
[6]   RGB-D SLAM with moving object tracking in dynamic environments [J].
Dai, Weichen ;
Zhang, Yu ;
Zheng, Yuxin ;
Sun, Donglei ;
Li, Ping .
IET CYBER-SYSTEMS AND ROBOTICS, 2021, 3 (04) :281-291
[7]   Enhancing RGB-D SLAM Performances Considering Sensor Specifications for Indoor Localization [J].
El Bouazzaoui, Imad ;
Florez, Sergio A. Rodriguez ;
El Ouardi, Abdelhafid .
IEEE SENSORS JOURNAL, 2022, 22 (06) :4970-4977
[8]   DUDMap: 3D RGB-D mapping for dense, unstructured, and dynamic environment [J].
Hasturk, Ozgur ;
Erkmen, Aydan M. .
INTERNATIONAL JOURNAL OF ADVANCED ROBOTIC SYSTEMS, 2021, 18 (03)
[9]   Object Detection Algorithm for Wheeled Mobile Robot Based on an Improved YOLOv4 [J].
Hu, Yanxin ;
Liu, Gang ;
Chen, Zhiyu ;
Guo, Jianwei .
APPLIED SCIENCES-BASEL, 2022, 12 (09)
[10]   Visual-SLAM Classical Framework and Key Techniques: A Review [J].
Jia, Guanwei ;
Li, Xiaoying ;
Zhang, Dongming ;
Xu, Weiqing ;
Lv, Haojie ;
Shi, Yan ;
Cai, Maolin .
SENSORS, 2022, 22 (12)