Near-Instant Capture of High-Resolution Facial Geometry and Reflectance

被引:27
作者
Fyffe, G. [1 ]
Graham, P. [1 ]
Tunwattanapong, B. [1 ]
Ghosh, A. [2 ]
Debevec, P. [1 ]
机构
[1] USC Inst Creat Technol, Washington, DC 20005 USA
[2] Univ London Imperial Coll Sci Technol & Med, London SW7 2AZ, England
关键词
SHAPE; SURFACE; COLOR; SKIN;
D O I
10.1111/cgf.12837
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a near-instant method for acquiring facial geometry and reflectance using a set of commodity DSLR cameras and flashes. Our setup consists of twenty-four cameras and six flashes which are fired in rapid succession with subsets of the cameras. Each camera records only a single photograph and the total capture time is less than the 67ms blink reflex. The cameras and flashes are specially arranged to produce an even distribution of specular highlights on the face. We employ this set of acquired images to estimate diffuse color, specular intensity, specular exponent, and surface orientation at each point on the face. We further refine the facial base geometry obtained from multi-view stereo using estimated diffuse and specular photometric information. This allows final submillimeter surface mesostructure detail to be obtained via shape-from-specularity. The final system uses commodity components and produces models suitable for authoring high-quality digital human characters.
引用
收藏
页码:353 / 363
页数:11
相关论文
共 37 条
[21]  
Mallick S., 2005, CVPR
[22]  
Mallick S.P., 2006, ECCV
[23]   Separation of reflection Components using color and polarization [J].
Nayar, SK ;
Fang, XS ;
Boult, T .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1997, 21 (03) :163-186
[24]   Efficiently combining positions and normals for precise 3D geometry [J].
Nehab, D ;
Rusinkiewicz, S ;
Davis, J ;
Ramamoorthi, R .
ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (03) :536-543
[25]  
Pighin F., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P75, DOI 10.1145/280814.280825
[26]   Out of plane polarimetric imaging of skin: Surface and subsurface effect [J].
Ramella-Roman, Jessica C. .
OPTICAL WAVEGUIDE SENSING AND IMAGING, 2008, :259-269
[27]  
Rushmeier H., 1997, Rendering Techniques '97. Proceedings of the Eurographics Workshop. Eurographics, P35
[28]  
Rusinkiewicz S, 2002, ACM T GRAPHIC, V21, P438, DOI 10.1145/566570.566600
[29]   Lightweight Binocular Facial Performance Capture under Uncontrolled Lighting [J].
Valgaerts, Levi ;
Wu, Chenglei ;
Bruhn, Andres ;
Seidel, Hans-Peter ;
Theobalt, Christian .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (06)
[30]   Analysis of human faces using a measurement-based skin reflectance model [J].
Weyrich, Tim ;
Matusik, Wojciech ;
Pfister, Hanspeter ;
Bickel, Bernd ;
Donner, Craig ;
Tu, Chien ;
McAndless, Janet ;
Lee, Jinho ;
Ngan, Addy ;
Jensen, Henrik Wann ;
Gross, Markus .
ACM TRANSACTIONS ON GRAPHICS, 2006, 25 (03) :1013-1024