Statistical Modeling of Craniofacial Shape and Texture

被引:89
作者
Dai, Hang [1 ,2 ]
Pears, Nick [1 ]
Smith, William [1 ]
Duncan, Christian [3 ]
机构
[1] Univ York, Dept Comp Sci, York, N Yorkshire, England
[2] Incept Inst AI, Abu Dhabi, U Arab Emirates
[3] Alder Hey Hosp, Liverpool, Merseyside, England
关键词
3D morphable model; Statistical shape model; Craniofacial shape; Shape morphing; 3D; REGISTRATION;
D O I
10.1007/s11263-019-01260-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a fully-automatic statistical 3D shape modeling approach and apply it to a large dataset of 3D images, the Headspace dataset, thus generating the first public shape-and-texture 3D morphable model (3DMM) of the full human head. Our approach is the first to employ a template that adapts to the dataset subject before dense morphing. This is fully automatic and achieved using 2D facial landmarking, projection to 3D shape, and mesh editing. In dense template morphing, we improve on the well-known Coherent Point Drift algorithm, by incorporating iterative data-sampling and alignment. Our evaluations demonstrate that our method has better performance in correspondence accuracy and modeling ability when compared with other competing algorithms. We propose a texture map refinement scheme to build high quality texture maps and texture model. We present several applications that include the first clinical use of craniofacial 3DMMs in the assessment of different types of surgical intervention applied to a craniosynostosis patient group.
引用
收藏
页码:547 / 571
页数:25
相关论文
共 55 条
[1]  
Amberg B, 2007, IEEE I CONF COMP VIS, P1326
[2]   Deep Transfer Network with 3D Morphable Models for Face Recognition [J].
An, Zhanfu ;
Deng, Weihong ;
Yuan, Tongtong ;
Hu, Jiani .
PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :416-422
[3]  
[Anonymous], 2 MICCAI WORKSH MATH
[4]  
[Anonymous], J VIRTUAL REALITY BR
[5]  
BEELER T, 2014, ACM T GRAPHIC, V33
[6]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[7]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[8]   Face recognition based on fitting a 3D morphable model [J].
Blanz, V ;
Vetter, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2003, 25 (09) :1063-1074
[9]   A Groupwise Multilinear Correspondence Optimization for 3D Faces [J].
Bolkart, Timo ;
Wuhrer, Stefanie .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3604-3612
[10]   Statistical Analysis of 3D Faces in Motion [J].
Bolkart, Timo ;
Wuhrer, Stefanie .
2013 INTERNATIONAL CONFERENCE ON 3D VISION (3DV 2013), 2013, :103-110