End-to-End RGB-D SLAM With Multi-MLPs Dense Neural Implicit Representations

被引:15
作者
Li, Mingrui [1 ]
He, Jiaming [1 ]
Wang, Yangyang [1 ,2 ]
Wang, Hongyu [1 ]
机构
[1] Dalian Univ Technol, Dalian 116024, Peoples R China
[2] Dalian Maritime Univ, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Dense SLAM; neural implicit coding; surface rendering; TRACKING;
D O I
10.1109/LRA.2023.3311365
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
An accurate and generalizable dense 3D reconstruction system has attracted much attention. However, existing 3D dense reconstruction systems are constrained by pre-training, and there is a need for enhanced reconstruction of texture and shape details. We propose an end-to-end 3D reconstruction system which achieves fine scene reconstruction without prior information by utilizing a neural implicit encoding. Our proposed system successfully achieves the goal through improved multi-MLP decoders (MLM) and an effective keyframe selection strategy. Experiments conducted on the commonly used Replica and TUM RGB-D datasets demonstrate that our approach can compete with widely adopted NeRF-based SLAM methods in terms of 3D reconstruction accuracy. Moreover, our approach shows a 40.8%(except Completion Ratio) improvement in accuracy compared to NICE-SLAM [14] and does not use prior information.
引用
收藏
页码:7138 / 7145
页数:8
相关论文
共 55 条
[1]   Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields [J].
Barron, Jonathan T. ;
Mildenhall, Ben ;
Tancik, Matthew ;
Hedman, Peter ;
Martin-Brualla, Ricardo ;
Srinivasan, Pratul P. .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :5835-5844
[2]   DynaSLAM II: Tightly-Coupled Multi-Object Tracking and SLAM [J].
Bescos, Berta ;
Campos, Carlos ;
Tardos, Juan D. ;
Neira, Jose .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03) :5191-5198
[3]   CodeSLAM-Learning a Compact, Optimisable Representation for Dense Visual SLAM [J].
Bloesch, Michael ;
Czarnowski, Jan ;
Clark, Ronald ;
Leutenegger, Stefan ;
Davison, Andrew J. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2560-2568
[4]   NeRF-SR: High Quality Neural Radiance Fields using Supersampling [J].
Wang, Chen ;
Wu, Xian ;
Guo, Yuan-Chen ;
Zhang, Song-Hai ;
Tai, Yu-Wing ;
Hu, Shi-Min .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :6445-6454
[5]   TANDEM: matching proteins with tandem mass spectra [J].
Craig, R ;
Beavis, RC .
BIOINFORMATICS, 2004, 20 (09) :1466-1467
[6]   DeepFactors: Real-Time Probabilistic Dense Monocular SLAM [J].
Czarnowski, Jan ;
Laidlow, Tristan ;
Clark, Ronald ;
Davison, Andrew J. .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :721-728
[7]   ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes [J].
Dai, Angela ;
Chang, Angel X. ;
Savva, Manolis ;
Halber, Maciej ;
Funkhouser, Thomas ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2432-2443
[8]   NeRFReN: Neural Radiance Fields with Reflections [J].
Guo, Yuan-Chen ;
Kang, Di ;
Bao, Linchao ;
He, Yu ;
Zhang, Song-Hai .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :18388-18397
[9]  
Handa A, 2014, IEEE INT CONF ROBOT, P1524, DOI 10.1109/ICRA.2014.6907054
[10]  
Hu B., 2022, P IEEE CVF C COMP VI, P23528