Automatic reconstruction of personalized avatars from 3D face scans

被引:77
作者
Zollhoefer, Michael [1 ]
Martinek, Michael [1 ]
Greiner, Guenther [1 ]
Stamminger, Marc [1 ]
Suessmuth, Jochen [1 ]
机构
[1] Univ Erlangen Nurnberg, Comp Graph Grp, D-91058 Erlangen, Germany
关键词
personalized avatars; face scanning; face reconstruction; face model fitting; Microsoft Kinect sensor; REGISTRATION;
D O I
10.1002/cav.405
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a simple algorithm for computing a high-quality personalized avatar from a single color image and the corresponding depth map which have been captured by Microsoft's Kinect sensor. Due to the low market price of our hardware setup, 3D face scanning becomes feasible for home use. The proposed algorithm combines the advantages of robust non-rigid registration and fitting of a morphable face model. We obtain a high-quality reconstruction of the facial geometry and texture along with one-to-one correspondences with our generic face model. This representation allows for a wide range of further applications such as facial animation or manipulation. Our algorithm has proven to be very robust. Since it does not require any user interaction, even non-expert users can easily create their own personalized avatars. Copyright (C) 2011 John Wiley & Sons, Ltd.
引用
收藏
页码:195 / 202
页数:8
相关论文
共 15 条
[1]  
[Anonymous], J VIRTUAL REALITY BR
[2]  
[Anonymous], 2000, Opencv. Dr. Dobb's journal of software tools
[3]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[4]  
BLANZ V, 2003, P ICCV 07, P1
[5]  
BLANZ V, 2003, P C COMP GRAPH INT T, P187
[6]   Automatic 3D Face Reconstruction from Single Images or Video [J].
Breuer, Pia ;
Kim, Kwang-In ;
Kienzle, Wolf ;
Schoelkopf, Bernhard ;
Blanz, Volker .
2008 8TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2008), VOLS 1 AND 2, 2008, :1-+
[7]   GENERALIZED PROCRUSTES ANALYSIS [J].
GOWER, JC .
PSYCHOMETRIKA, 1975, 40 (01) :33-51
[8]  
KIM YS, 2010, P ICIP 10, P1821
[9]  
LEE J, 2005, P EUR S REND, P73
[10]   Global correspondence optimization for non-rigid registration of depth scans [J].
Li, Hao ;
Sumner, Robert W. ;
Pauly, Mark .
COMPUTER GRAPHICS FORUM, 2008, 27 (05) :1421-1430