SSF-SLAM: Real-Time RGB-D Visual SLAM for Complex Dynamic Environments Based on Semantic and Scene Flow Geometric Information

被引：0

作者：

Zhang, Ziqi ^{[1
,2
]}

Song, Yong ^{[1
,2
]}

Pang, Bao ^{[1
,2
]}

Yuan, Xianfeng ^{[1
,2
]}

Xu, Qingyang ^{[1
,2
]}

Xu, Xiaolong ^{[1
,2
]}

机构：

[1] Shandong University, School of Mechanical, Electrical, and Information Engineering, Weihai,264209, China

[2] Shandong Key Laboratory of Intelligent Electronic Packaging Testing and Application, Weihai,264209, China

来源：

IEEE Transactions on Instrumentation and Measurement | 2025年 / 74卷

基金：

中国国家自然科学基金;

关键词：

3D modeling - Computer vision - Geometry - Mobile robots - Object detection - Object recognition - SLAM robotics - Three dimensional computer graphics;

D O I：

暂无

中图分类号：

学科分类号：

摘要：

Most existing simultaneous localization and mapping (SLAM) algorithms rely on static world assumptions and perform poorly in complex dynamic environments. In order to improve the accuracy and robustness of SLAM in complex dynamic environments, based on ORB-SLAM2, this article proposes a SLAM system that combines semantic information and scene flow geometry information (SSF-SLAM). Semantic information is the core of robot scene understanding and cognition. First, a lightweight object detection module is constructed and the acquired semantic information is innovatively coupled with multiview geometry to achieve rapid and accurate dynamic object recognition. Then, a novel clustering module of scene flow geometry information based on depth and density is designed, which can effectively reduce the limitation of geometric constraints and realize fast and accurate calculation of geometric dynamic regions. In addition, a semantic mapping module is also built to generate 3-D point clouds and 3-D semantic objects to help mobile robots understand scenes in actual tasks. In SSF-SLAM, the object detecting module and semantic mapping module are integrated into a single thread and run in parallel to ensure the real-time performance of the system. Finally, the method was tested on various public datasets and real-world environment, and the results showed that compared with other advanced methods, SSF-SLAM performed better in terms of timeliness, accuracy, and robustness. © 1963-2012 IEEE.

引用