A Monocular SLAM System Based on ResNet Depth Estimation

被引:3
|
作者
Li, Zheng [1 ]
Yu, Lei [1 ]
Pan, Zihao [1 ]
机构
[1] Soochow Univ, Dept Mech & Elect Engn, Suzhou 215131, Peoples R China
基金
中国国家自然科学基金;
关键词
Simultaneous localization and mapping; Estimation; Sensors; Training; Task analysis; Visualization; Computer architecture; Dense mapping; monocular depth estimation; pose estimation; transfer learning;
D O I
10.1109/JSEN.2023.3275324
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Currently, monocular simultaneous location and mapping (SLAM) systems cannot extract depth information from monocular cameras directly and require initialization to solve the problem of scale uncertainty. It is extremely difficult to reconstruct maps using such systems, and it is difficult to cope with scenarios that require navigation and obstacle avoidance. In order to solve the above problems, in this article, a simple monocular depth estimation network framework is proposed. Transfer learning from a pre-trained ResNet is utilized for the encoding part of the framework and a convolutional neural network (CNN) is used for the decoding part. Only a few training parameters and iterations are required to obtain fairly accurate depth information. At the same time, a similarity-based filter is used to denoise the surfels and improve the red green blue-depth (RGB-D) SLAM system, which not only reduces the impact of the depth estimation error on the surfels but also ensures the quality of the dense mapping. From the results of comparative experiments, it can be seen that the proposed monocular depth estimation network framework is better than current popular methods, and the associated SLAM system can achieve pose estimation and dense mapping tasks. As a monocular camera-based SLAM system, the proposed method is a promising and practical approach.
引用
收藏
页码:15106 / 15114
页数:9
相关论文
共 50 条
  • [41] Multiple Maps for the Feature-based Monocular SLAM System
    Hu, Huan
    Sun, Hanxu
    Ye, Ping
    Jia, Qingxuan
    Gao, Xin
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2019, 94 (02) : 389 - 404
  • [42] Monocular SLAM System in Dynamic Scenes Based on Semantic Segmentation
    Sheng, Chao
    Pan, Shuguo
    Zeng, Pan
    Huang, Lixiao
    Zhao, Tao
    IMAGE AND GRAPHICS, ICIG 2019, PT III, 2019, 11903 : 593 - 603
  • [43] Sparse depth densification for monocular depth estimation
    Zhen Liang
    Tiyu Fang
    Yanzhu Hu
    Yingjian Wang
    Multimedia Tools and Applications, 2024, 83 : 14821 - 14838
  • [44] Multiple Maps for the Feature-based Monocular SLAM System
    Huan Hu
    Hanxu Sun
    Ping Ye
    Qingxuan Jia
    Xin Gao
    Journal of Intelligent & Robotic Systems, 2019, 94 : 389 - 404
  • [45] A monocular SLAM system based on SIFT features for gastroscope tracking
    Yifan Wang
    Liang Zhao
    Lun Gong
    Xin Chen
    Siyang Zuo
    Medical & Biological Engineering & Computing, 2023, 61 : 511 - 523
  • [46] Accurate Initial State Estimation in a Monocular Visual-Inertial SLAM System
    Mu, Xufu
    Chen, Jing
    Zhou, Zixiang
    Leng, Zhen
    Fan, Lei
    SENSORS, 2018, 18 (02)
  • [47] Depth Map Decomposition for Monocular Depth Estimation
    Jun, Jinyoung
    Lee, Jae-Han
    Lee, Chul
    Kim, Chang-Su
    COMPUTER VISION - ECCV 2022, PT II, 2022, 13662 : 18 - 34
  • [48] Sparse depth densification for monocular depth estimation
    Liang, Zhen
    Fang, Tiyu
    Hu, Yanzhu
    Wang, Yingjian
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (05) : 14821 - 14838
  • [49] Monocular Depth Estimation Based on Multi-Scale Depth Map Fusion
    Yang, Xin
    Chang, Qingling
    Liu, Xinglin
    He, Siyuan
    Cui, Yan
    IEEE ACCESS, 2021, 9 : 67696 - 67705
  • [50] MOTSLAM: MOT-assisted monocular dynamic SLAM using single-view depth estimation
    Zhang, Hanwei
    Uchiyama, Hideaki
    Ono, Shintaro
    Kawasaki, Hiroshi
    2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2022, : 4865 - 4872