PSPNet-SLAM: A Semantic SLAM Detect Dynamic Object by Pyramid Scene Parsing Network

被引:36
|
作者
Long, Xudong [1 ]
Zhang, Weiwei [1 ]
Zhao, Bo [1 ]
机构
[1] Shanghai Univ Engn Sci, Sch Mech & Automot Engn, Shanghai 201620, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Semantics; Feature extraction; Vehicle dynamics; Real-time systems; Cameras; Instruction sets; PSPNet-SLAM; dynamic; semantic; OCMulti-view geometry; MONOCULAR SLAM;
D O I
10.1109/ACCESS.2020.3041038
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Simultaneous Localization and Mapping (SLAM) plays an important role in the computer vision and robotic field. The traditional SLAM framework adopts a strong static world assumption for convenience of analysis. It is very essential to know how to deal with the dynamic environment in the entire industry with widespread attention. Faced with these challenges, researchers consider introducing semantic information to collaboratively solve dynamic objects in the scene. So, in this paper, we proposed a PSPNet-SLAM: Pyramid Scene Parsing Network SLAM, which integrated the Semantic thread of pyramid structure and geometric threads of reverse ant colony search strategy into ORB-SLAM2. In the proposed system, a pyramid-structured PSPNet was used for semantic thread to segment dynamic objects in combination with context information. In the geometric thread, we proposed a OCMulti-View Geometry thread. On the one hand, the optimal error compensation homography matrix was designed to improve the accuracy of dynamic point detection. On the other hand, we came up with a reverse ant colony collection strategy to enhance the real-time performance of the system and reduce its time consumption during the detection of dynamic objects. We have evaluated our SLAM in public data sheets and real-time world and compared it with ORB-SLAM2, DynaSLAM. Many improvements have been achieved in this system including location accuracy in high-dynamic scenarios, which also outperformed the other four state-of-the-art SLAM systems coping with the dynamic environments. The real-time performance has been delivered, compared with the geometric thread of the excellent DynaSALM system.
引用
收藏
页码:214685 / 214695
页数:11
相关论文
共 50 条
  • [1] AM-PSPNet: Pyramid Scene Parsing Network Based on Attentional Mechanism for Image Semantic Segmentation
    Wu, Dikang
    Zhao, Jiamei
    Wang, Zhifang
    DATA SCIENCE (ICPCSEE 2022), PT I, 2022, 1628 : 425 - 434
  • [2] Monocular Semantic SLAM in Dynamic Street Scene Based on Multiple Object Tracking
    Chen, Wen
    Fang, Mu
    Liu, Yun-Hui
    Li, Luyang
    2017 IEEE INTERNATIONAL CONFERENCE ON CYBERNETICS AND INTELLIGENT SYSTEMS (CIS) AND IEEE CONFERENCE ON ROBOTICS, AUTOMATION AND MECHATRONICS (RAM), 2017, : 599 - 604
  • [3] Monocular semantic SLAM in dynamic street scene based on multiple object tracking
    Chen, Wen
    Fang, Mu
    Liu, Yun-Hui
    Li, Luyang
    2017 IEEE International Conference on Cybernetics and Intelligent Systems, CIS 2017 and IEEE Conference on Robotics, Automation and Mechatronics, RAM 2017 - Proceedings, 2017, 2018-January : 599 - 604
  • [4] AGAM-SLAM: An Adaptive Dynamic Scene Semantic SLAM Method Based on GAM
    Cai, Dupeng
    Hu, Zhuhua
    Li, Ruoqing
    Qi, Hao
    Xiang, Yunfeng
    Zhao, Yaochi
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, ICIC 2023, PT V, 2023, 14090 : 27 - 39
  • [5] Dynamic Scene Semantics SLAM Based on Semantic Segmentation
    Han, Shuangquan
    Xi, Zhihong
    IEEE ACCESS, 2020, 8 : 43563 - 43570
  • [6] STDC-SLAM: A Real-Time Semantic SLAM Detect Object by Short-Term Dense Concatenate Network
    Hu, Zhangfang
    Chen, Jian
    Luo, Yuan
    Zhang, Yi
    IEEE ACCESS, 2022, 10 : 129419 - 129428
  • [7] Study on Slam Algorithm Based on Object Detection in Dynamic Scene
    Li, Ping
    Zhang, Guoqing
    Zhou, Jianluo
    Yao, Ruolong
    Zhang, Xuexi
    Thou, Jianluo
    2019 INTERNATIONAL CONFERENCE ON ADVANCED MECHATRONIC SYSTEMS (ICAMECHS), 2019, : 363 - 367
  • [8] Pyramid Scene Parsing Network
    Zhao, Hengshuang
    Shi, Jianping
    Qi, Xiaojuan
    Wang, Xiaogang
    Jia, Jiaya
    30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6230 - 6239
  • [9] Blitz-SLAM: A semantic SLAM in dynamic environments
    Fan, Yingchun
    Zhang, Qichi
    Tang, Yuliang
    Liu, Shaofen
    Han, Hong
    PATTERN RECOGNITION, 2022, 121
  • [10] LRD-SLAM: A Lightweight Robust Dynamic SLAM Method by Semantic Segmentation Network
    Jia, Shifeng
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2022, 2022