Dynamic Scene Semantics SLAM Based on Semantic Segmentation

被引:67
作者
Han, Shuangquan [1 ]
Xi, Zhihong [1 ]
机构
[1] Harbin Engn Univ, Sch Informat & Commun Engn, Harbin 150001, Peoples R China
关键词
SLAM; semantic SLAM; indoor dynamic scene; semantic segmentation; OBJECT;
D O I
10.1109/ACCESS.2020.2977684
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous Localization and Mapping (SLAM) have become a new research hotspot in the field of artificial intelligence applications such as unmanned driving and mobile robots. Most of the current SLAM research is based on the assumption of static scenes, and dynamic objects in the indoor environment are inevitable. The assumption based on static scenes greatly limits the development of SLAM and the application of SLAM system in real life. At the same time, the semantic segmentation is added to the SLAM system to generate a semantic map with semantic information, which can enrich the understanding of the mobile carrier to the environment and obtain high-level perception. In this paper, we combine the visual SLAM system ORB-SLAM2 and PSPNet semantic segmentation network, and propose a PSPNet-SLAM system, which uses optical flow and semantic segmentation to detect and eliminate dynamic points to achieve dynamic scenes semantic SLAM. We performed experiments on the TUM RGB-D dataset. The results show that compared with other SLAM systems, PSPNet-SLAM can reduce the camera pose estimation error in indoor dynamic scenes to different degrees and improve the camera position estimation accurately.
引用
收藏
页码:43563 / 43570
页数:8
相关论文
共 22 条
[21]  
[于金山 Yu Jinshan], 2016, [机器人, Robot], V38, P410
[22]   Pyramid Scene Parsing Network [J].
Zhao, Hengshuang ;
Shi, Jianping ;
Qi, Xiaojuan ;
Wang, Xiaogang ;
Jia, Jiaya .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6230-6239