DO-SLAM: research and application of semantic SLAM system towards dynamic environments based on object detection

被引:18
作者
Wei, Yaoguang [1 ,2 ,3 ,4 ]
Zhou, Bingqian [1 ,4 ]
Duan, Yunhong [1 ,4 ]
Liu, Jincun [1 ,2 ,4 ]
An, Dong [1 ,2 ,4 ]
机构
[1] China Agr Univ, Natl Innovat Ctr Digital Fishery, Beijing 100083, Peoples R China
[2] China Agr Univ, Key Lab Smart Farming Aquat Anim & Livestock, Minist Agr & Rural Affairs, Beijing 100083, Peoples R China
[3] Beijing Engn & Technol Res Ctr Internet Things Agr, Beijing 100083, Peoples R China
[4] China Agr Univ, Coll Informat & Elect Engn, Beijing 100083, Peoples R China
关键词
Simultaneous localization and mapping (SLAM); Outlier detection mechanism; Object detection; Dynamic environments; VISUAL SLAM; MODEL;
D O I
10.1007/s10489-023-05070-w
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Simultaneous Localization and Mapping (SLAM) is one of the research hotspots in the field of robotics, and it is also a prerequisite for autonomous robot navigation. The localization accuracy and stability of traditional SLAM based on static scene assumption declines due to the interference of dynamic objects. To solve the problem, this paper proposes a semantic SLAM system for dynamic environments based on object detection named DO-SLAM. Firstly, DO-SLAM uses YOLOv5 to identify objects in dynamic environments and obtains the semantic information; Then, combined with the outlier detection mechanism proposed in this paper, the dynamic objects are effectively determined and the feature points on the dynamic objects are eliminated; The combination method can reduce the interference of dynamic objects to SLAM, and improve the stability and localization accuracy of the system. At the same time, a static dense point cloud map is constructed for high-level tasks. Finally, the effectiveness of DO-SLAM is verified on the TUM RGB-D dataset. The results show that the Absolute Trajectory Error (ATE) and Relative Pose Error (RPE) are reduced, indicating that DO-SLAM can reduce the interference of dynamic objects.
引用
收藏
页码:30009 / 30026
页数:18
相关论文
共 59 条
[1]   Semantic-Direct Visual Odometry [J].
Bao, Yaoqi ;
Yang, Zhe ;
Pan, Yun ;
Huan, Ruohong .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) :6718-6725
[2]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[3]  
Bochkovskiy A., 2020, ARXIV
[4]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[5]   A Monocular-Visual SLAM System with Semantic and Optical-Flow Fusion for Indoor Dynamic Environments [J].
Chen, Weifeng ;
Shang, Guangtao ;
Hu, Kai ;
Zhou, Chengjun ;
Wang, Xiyang ;
Fang, Guisheng ;
Ji, Aihong .
MICROMACHINES, 2022, 13 (11)
[6]   Robust Visual Localization in Dynamic Environments Based on Sparse Motion Removal [J].
Cheng, Jiyu ;
Wang, Chaoqun ;
Meng, Max Q-H .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (02) :658-669
[7]   Improving monocular visual SLAM in dynamic environments: an optical-flow-based approach [J].
Cheng, Jiyu ;
Sun, Yuxiang ;
Meng, Max Q-H .
ADVANCED ROBOTICS, 2019, 33 (12) :576-589
[8]   Matching with PROSAC - Progressive Sample Consensus [J].
Chum, O ;
Matas, J .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :220-226
[9]   DeepFactors: Real-Time Probabilistic Dense Monocular SLAM [J].
Czarnowski, Jan ;
Laidlow, Tristan ;
Clark, Ronald ;
Davison, Andrew J. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :721-728
[10]   RGB-D SLAM in Dynamic Environments Using Point Correlations [J].
Dai, Weichen ;
Zhang, Yu ;
Li, Ping ;
Fang, Zheng ;
Scherer, Sebastian .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (01) :373-389