Bayesian Tensor Approach for 3-D Face Modeling

被引:84
作者
Tao, Dacheng [1 ]
Song, Mingli [2 ]
Li, Xuelong [7 ]
Shen, Jialie [3 ]
Sun, Jimeng [4 ]
Wu, Xindong [5 ]
Faloutsos, Christos [6 ]
Maybank, Stephen J. [7 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Zhejiang Univ, Coll Comp Sci, Microsoft Visual Percept Lab, Hangzhou 310027, Zhejiang, Peoples R China
[3] Singapore Management Univ, Sch Informat Syst, Singapore, Singapore
[4] IBM TJ Watson Lab, Hawthorne, NY 10523 USA
[5] Univ Vermont, Dept Comp Sci, Burlington, VT 05405 USA
[6] Carnegie Mellon Univ, Dept Comp Sci, Pittsburgh, PA 15213 USA
[7] Univ London, Birkbeck Coll, Sch Comp Sci & Informat Syst, London WC1E 7HX, England
基金
美国国家科学基金会; 中国国家自然科学基金;
关键词
Bayesian inference; Bayesian tensor analysis; face expression synthesis; 3-D face;
D O I
10.1109/TCSVT.2008.2002825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Effectively modeling a collection of three-dimensional (3-D) faces is an important task in various applications, especially facial expression-driven ones, e.g., expression generation, retargeting, and synthesis. These 3-D faces naturally form a set of second-order tensors one modality for identity and the other for expression. The number of these second-order tensors is three times of that of the vertices for 3-D face modeling. As for algorithms'. Bayesian data modeling, which is a natural data analysis tool, has been widely applied with great success; however, it works only for vector data. Therefore, there is a gap between tensor-based representation and vector-based data analysis tools. Aiming at bridging this gap and generalizing conventional statistical tools over tensors, this paper proposes a decoupled probabilistic algorithm, which is named Bayesian tensor analysis (BTA). Theoretically, BTA can automatically and suitably determine dimensionality for different modalities of tensor data. With BTA. a collection of 3-D faces can be well modeled. Empirical studies on expression retargeting also justify the advantages of BTA.
引用
收藏
页码:1397 / 1410
页数:14
相关论文
共 38 条
[11]  
He Xiaofei., 2005, NIPS, V4, P1
[12]   PRINCIPAL COMPONENT ANALYSIS OF 3-MODE DATA BY MEANS OF ALTERNATING LEAST-SQUARES ALGORITHMS [J].
KROONENBERG, PM ;
DELEEUW, J .
PSYCHOMETRIKA, 1980, 45 (01) :69-97
[13]  
Lathauwer L. D., 1997, THESIS KATHOLIKE U L
[14]  
LEFOHN AE, 2005, IEEE VISUALIZATION T
[16]  
Noh JY, 2001, COMP GRAPH, P277, DOI 10.1145/383259.383290
[17]   A feature-based approach to facial expression cloning [J].
Park, B ;
Chung, HJ ;
Nishita, T ;
Shin, SY .
COMPUTER ANIMATION AND VIRTUAL WORLDS, 2005, 16 (3-4) :291-303
[18]  
PARKE FI, 1982, IEEE COMPUT GRAPH, V2, P61
[19]  
PARKE FI, 1974, THESIS U UTAH SALT L
[20]  
PARKE FI, 1998, COMPUT FACIAL ANIMAT