SDF-2-SDF Registration for Real-Time 3D Reconstruction from RGB-D Data

被引:14
作者
Slavcheva, Miroslava [1 ,2 ]
Kehl, Wadim [1 ,3 ]
Navab, Nassir [1 ]
Ilic, Slobodan [1 ,2 ]
机构
[1] Tech Univ Munich, Munich, Germany
[2] Siemens CT, Munich, Germany
[3] Toyota Res Inst, Los Altos, CA USA
关键词
Signed distance field; Registration; 3D reconstruction; Camera tracking; Global optimization; RGB-D sensors; LEVEL-SET; INTEGRATION; IMAGES; RESOLUTION;
D O I
10.1007/s11263-017-1057-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We tackle the task of dense 3D reconstruction from RGB-D data. Contrary to the majority of existing methods, we focus not only on trajectory estimation accuracy, but also on reconstruction precision. The key technique is SDF-2-SDF registration, which is a correspondence-free, symmetric, dense energy minimization method, performed via the direct voxel-wise difference between a pair of signed distance fields. It has a wider convergence basin than traditional point cloud registration and cloud-to-volume alignment techniques. Furthermore, its formulation allows for straightforward incorporation of photometric and additional geometric constraints. We employ SDF-2-SDF registration in two applications. First, we perform small-to-medium scale object reconstruction entirely on the CPU. To this end, the camera is tracked frame-to-frame in real time. Then, the initial pose estimates are refined globally in a lightweight optimization framework, which does not involve a pose graph. We combine these procedures into our second, fully real-time application for larger-scale object reconstruction and SLAM. It is implemented as a hybrid system, whereby tracking is done on the GPU, while refinement runs concurrently over batches on the CPU. To bound memory and runtime footprints, registration is done over a fixed number of limited-extent volumes, anchored at geometry-rich locations. Extensive qualitative and quantitative evaluation of both trajectory accuracy and model fidelity on several public RGB-D datasets, acquired with various quality sensors, demonstrates higher precision than related techniques.
引用
收藏
页码:615 / 636
页数:22
相关论文
共 80 条
  • [1] A FAST LEVEL SET METHOD FOR PROPAGATING INTERFACES
    ADALSTEINSSON, D
    SETHIAN, JA
    [J]. JOURNAL OF COMPUTATIONAL PHYSICS, 1995, 118 (02) : 269 - 277
  • [2] Adorno BV, 2011, IEEE INT CONF ROBOT
  • [3] [Anonymous], 2007, COMP VIS 2007 ICCV 2
  • [4] [Anonymous], 2001, An Invitation to 3-D Vision
  • [5] [Anonymous], 2016, ARXIV160202481
  • [6] [Anonymous], 2008, ZPRINTER 650 HARDW M
  • [7] [Anonymous], 2013 IEEE RSJ INT C
  • [8] [Anonymous], INT C 3D VIS 3DV
  • [9] [Anonymous], 2011, P ACM S US INT SOFTW
  • [10] [Anonymous], INT S EXP ROB