Large-Scale Dense Mapping System Based on Visual-Inertial Odometry and Densely Connected U-Net

被引:11
作者
Fan, Chuanliu [1 ]
Hou, Junyi [1 ]
Yu, Lei [1 ]
机构
[1] Soochow Univ, Sch Mech & Elect Engn, Suzhou 215000, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D reconstruction; inertial measurement unit (IMU); monocular depth estimation; visual-inertial odometry (VIO); voxel hash; VERSATILE; SLAM;
D O I
10.1109/TIM.2023.3250301
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Simultaneous localization and mapping (SLAM)-based 3-D reconstruction system mainly relies on visual odometry, which uses detailed scanning to obtain better reconstruction results. Among the feature-based SLAM methods, it is difficult to have good reconstruction results where features are missing even when the camera moves slowly. For the direct methods, when exposure changes and blurring occurs, tracking loss will cause unsatisfactory reconstruction effects. This article proposes a large-scale mapping system based on visual-inertial odometry (VIO) to solve these problems. The combination of vision and inertial measurement unit (IMU) is used to constrain the trajectory estimation in areas where the corners are missing. The system supports depth both obtained by the depth camera and estimated by the neural network. According to the voxel hash mechanism, we only focus on the voxels within the cutoff distance and use the hash table to represent the voxels sparsely to reduce the memory usage. Experiments show that the proposed system can obtain an ideal 3-D reconstruction model.
引用
收藏
页数:16
相关论文
共 59 条
[1]  
Alhashim I, 2019, Arxiv, DOI arXiv:1812.11941
[2]  
Bae Gwangbin, 2022, arXiv
[3]   DynaSLAM: Tracking, Mapping, and Inpainting in Dynamic Scenes [J].
Bescos, Berta ;
Facil, Jose M. ;
Civera, Javier ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :4076-4083
[4]   AdaBins: Depth Estimation Using Adaptive Bins [J].
Bhat, Shariq Farooq ;
Alhashim, Ibraheem ;
Wonka, Peter .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4008-4017
[5]   ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial, and Multimap SLAM [J].
Campos, Carlos ;
Elvira, Richard ;
Gomez Rodriguez, Juan J. ;
Montiel, Jose M. M. ;
Tardos, Juan D. .
IEEE TRANSACTIONS ON ROBOTICS, 2021, 37 (06) :1874-1890
[6]   A Variable Radius Side Window Direct SLAM Method Based on Semantic Information [J].
Chen, Yan ;
Ni, Jianjun ;
Mutabazi, Emmanuel ;
Cao, Weidong ;
Yang, Simon X. .
COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
[7]  
Dai A, 2017, ACM T GRAPHIC, V36, DOI [10.1145/3072959.3126814, 10.1145/3054739]
[8]   Direct Sparse Odometry [J].
Engel, Jakob ;
Koltun, Vladlen ;
Cremers, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (03) :611-625
[9]   LSD-SLAM: Large-Scale Direct Monocular SLAM [J].
Engel, Jakob ;
Schoeps, Thomas ;
Cremers, Daniel .
COMPUTER VISION - ECCV 2014, PT II, 2014, 8690 :834-849
[10]   On-Manifold Preintegration for Real-Time Visual-Inertial Odometry [J].
Forster, Christian ;
Carlone, Luca ;
Dellaert, Frank ;
Scaramuzza, Davide .
IEEE TRANSACTIONS ON ROBOTICS, 2017, 33 (01) :1-21