Real-Time 3D Reconstruction of Large-Scale Scenes with LOD Representation

被引:1
作者
Fu, Haohai [1 ,2 ,3 ]
Yang, Huamin [1 ]
Chen, Chunyi [1 ]
机构
[1] Changchun Univ Sci & Technol Changchun, Sch Comp Sci & Technol, Jilin 130022, Peoples R China
[2] Changchun Inst Technol, Changchun 130012, Jilin, Peoples R China
[3] Jilin Prov Key Lab Changbai Hist Culture & VR Reco, Jilin 130012, Peoples R China
关键词
3D reconstruction; LOD representation; real-time; RGB-D camera; INTEGRATION;
D O I
10.1142/S0218001423550017
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-time 3D reconstruction of static scenes can be achieved based on the RGB-D image sequence fusion. It is a popular practice to divide the space into uniform voxels and use a truncated signed distance function to represent surface information. In order to represent a scene of large scale, the voxel hash algorithm which stores voxels compressively can be used, but most of the conventional methods do not consider the complexity and roughness of the object surface in the scene, so the scene is represented with a uniform resolution. It somewhat limits the range of scene representation and the speed of real-time reconstruction. In this paper, a large-scale scene reconstruction algorithm based on voxel hashing storage with LOD representation is proposed. The main contributions include the following two aspects: (1) By preprocessing the depth image with smooth filtering, which ensures the accuracy of the data, it can effectively reduce the distortion caused by the sensor itself and violent motion and provide better support for the stages of voxel hashing, model rendering, and frame-to-model camera position tracking. (2) The 3D reconstruction with LOD representation is realized. We take the view distance and the roughness of the model surface as criteria to control the adaptive division and representation of spatial voxel blocks. Finally, we carried out qualitative and quantitative evaluations of the algorithm, and confirmed that the algorithm can achieve real-time reconstruction with different levels of detail in the commercial graphics processing hardware environment, and achieve a good fusion effect in large-scale scenes.
引用
收藏
页数:22
相关论文
共 31 条
[1]   Scalable Real-time Volumetric Surface Reconstruction [J].
Chen, Jiawen ;
Bautembach, Dennis ;
Izadi, Shahram .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (04)
[2]  
Curless B., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P303, DOI 10.1145/237170.237269
[3]   BundleFusion: Real-Time Globally Consistent 3D Reconstruction Using On-the-Fly Surface Reintegration [J].
Dai, Angela ;
Niessner, Matthias ;
Zollhofer, Michael ;
Izadi, Shahram ;
Theobalt, Christian .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (03)
[4]  
Frisken SF, 2000, COMP GRAPH, P249, DOI 10.1145/344779.344899
[5]   Texture Mapping for 3D Reconstruction with RGB-D Sensor [J].
Fu, Yanping ;
Yan, Qingan ;
Yang, Long ;
Liao, Jie ;
Xiao, Chunxia .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :4645-4653
[6]  
Henry P., 2013, RSS WORKSHOP RGB D A
[7]   RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments [J].
Henry, Peter ;
Krainin, Michael ;
Herbst, Evan ;
Ren, Xiaofeng ;
Fox, Dieter .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2012, 31 (05) :647-663
[8]  
Hilton A., 1996, Computer Vision - ECCV '96. 4th Eurpean Conference on Computer Proceedings, P117, DOI 10.1007/BFb0015528
[9]   Very High Frame Rate Volumetric Integration of Depth Images on Mobile Devices [J].
Kaehler, Olaf ;
Prisacariu, Victor Adrian ;
Ren, Carl Yuheng ;
Sun, Xin ;
Torr, Philip ;
Murray, David .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2015, 21 (11) :1241-1250
[10]   Hierarchical Voxel Block Hashing for Efficient Integration of Depth Images [J].
Kahler, Olaf ;
Prisacariu, Victor ;
Valentin, Julien ;
Murray, David .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2016, 1 (01) :192-197