A semantic SLAM-based dense mapping approach for large-scale dynamic outdoor environment

被引:18
作者
Yang, Linjie [1 ]
Wang, Luping [1 ]
机构
[1] Sun Yat sen Univ, Guangdong Prov Key Lab Adv IntelliSense Technol, Shenzhen 518107, Peoples R China
关键词
Visual SLAM; Semantic feature; Dynamic outdoor scene; Deep learning; Dense map;
D O I
10.1016/j.measurement.2022.112001
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The visual SLAM in dynamic environment has been regarded as a fundamental task for robots. Currently, existing works achieve good performance in only indoor scenes due to the loss of depth information and scene complexity. In this paper, we present a semantic SLAM framework based on geometric constraint and deep learning models. Specifically, our method is built top on the ORB-SLAM2 system with stereo observation. First, the semantic feature and depth information are acquired respectively using different deep learning models. In this way, multiple views projection is generated to reduce the impact of moving objects for pose estimation. Under the hierarchical rule, the feature points are further refined for SLAM tracking via depth local contrast. Finally, multiple dense 3D maps are created for high-level robot navigation in an incremental updating manner. Our method on public KITTI dataset demonstrates that evaluation metrics of most of sequences improve and achieve state-of-the-art performance.
引用
收藏
页数:9
相关论文
共 48 条
  • [41] NLA-GCL-Net: semantic segmentation of large-scale surveying point clouds based on neighborhood label aggregation (NLA) and global context learning (GCL)
    Wang, Jianhua
    Fan, Wenping
    Song, Xueyan
    Yao, Guobiao
    Bo, Mengmeng
    Liu, Ze
    [J]. INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2024, 38 (11) : 2325 - 2347
  • [42] RETRACTED: A novel large-scale multimedia image data classification algorithm based on mapping assisted deep neural network (Retracted article. See SEP, 2022)
    Li, Jun
    Singh, Rishav
    Singh, Ritika
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (18) : 18687 - 18710
  • [43] Automating Rey Complex Figure Test scoring using a deep learning-based approach: a potential large-scale screening tool for cognitive decline
    Park, Jun Young
    Seo, Eun Hyun
    Yoon, Hyung-Jun
    Won, Sungho
    Lee, Kun Ho
    [J]. ALZHEIMERS RESEARCH & THERAPY, 2023, 15 (01)
  • [44] Automating Rey Complex Figure Test scoring using a deep learning-based approach: a potential large-scale screening tool for cognitive decline
    Jun Young Park
    Eun Hyun Seo
    Hyung-Jun Yoon
    Sungho Won
    Kun Ho Lee
    [J]. Alzheimer's Research & Therapy, 15
  • [45] AE-GAN-Net: Learning Invariant Feature Descriptor to Match Ground Camera Images and a Large-Scale 3D Image-Based Point Cloud for Outdoor Augmented Reality
    Liu, Weiquan
    Wang, Cheng
    Bian, Xuesheng
    Chen, Shuting
    Li, Wei
    Lin, Xiuhong
    Li, Yongchuan
    Weng, Dongdong
    Lai, Shang-Hong
    Li, Jonathan
    [J]. REMOTE SENSING, 2019, 11 (19)
  • [46] A Deep Learning-Based Approach to Predict Large-Scale Dynamics of Normalized Difference Vegetation Index for the Monitoring of Vegetation Activities and Stresses Using Meteorological Data
    Sun, Ying
    Lao, Dazhao
    Ruan, Yongjian
    Huang, Chen
    Xin, Qinchuan
    [J]. SUSTAINABILITY, 2023, 15 (08)
  • [47] WILDFIRE-S1S2-CANADA: A LARGE-SCALE SENTINEL-1/2 WILDFIRE BURNED AREA MAPPING DATASET BASED ON THE 2017-2019 WILDFIRES IN CANADA
    Zhang, Puzhao
    Hu, Xikun
    Ban, Yifang
    [J]. 2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 7954 - 7957
  • [48] Spatial-temporal offshore wind speed characteristics prediction based on an improved purely 2D CNN approach in a large-scale perspective using reanalysis dataset
    Zhang, Zeguo
    Yin, Jianchuan
    [J]. ENERGY CONVERSION AND MANAGEMENT, 2024, 299