Bayesian Tensor Approach for 3-D Face Modeling

被引:84
作者
Tao, Dacheng [1 ]
Song, Mingli [2 ]
Li, Xuelong [7 ]
Shen, Jialie [3 ]
Sun, Jimeng [4 ]
Wu, Xindong [5 ]
Faloutsos, Christos [6 ]
Maybank, Stephen J. [7 ]
机构
[1] Nanyang Technol Univ, Sch Comp Engn, Singapore 639798, Singapore
[2] Zhejiang Univ, Coll Comp Sci, Microsoft Visual Percept Lab, Hangzhou 310027, Zhejiang, Peoples R China
[3] Singapore Management Univ, Sch Informat Syst, Singapore, Singapore
[4] IBM TJ Watson Lab, Hawthorne, NY 10523 USA
[5] Univ Vermont, Dept Comp Sci, Burlington, VT 05405 USA
[6] Carnegie Mellon Univ, Dept Comp Sci, Pittsburgh, PA 15213 USA
[7] Univ London, Birkbeck Coll, Sch Comp Sci & Informat Syst, London WC1E 7HX, England
基金
中国国家自然科学基金; 美国国家科学基金会;
关键词
Bayesian inference; Bayesian tensor analysis; face expression synthesis; 3-D face;
D O I
10.1109/TCSVT.2008.2002825
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Effectively modeling a collection of three-dimensional (3-D) faces is an important task in various applications, especially facial expression-driven ones, e.g., expression generation, retargeting, and synthesis. These 3-D faces naturally form a set of second-order tensors one modality for identity and the other for expression. The number of these second-order tensors is three times of that of the vertices for 3-D face modeling. As for algorithms'. Bayesian data modeling, which is a natural data analysis tool, has been widely applied with great success; however, it works only for vector data. Therefore, there is a gap between tensor-based representation and vector-based data analysis tools. Aiming at bridging this gap and generalizing conventional statistical tools over tensors, this paper proposes a decoupled probabilistic algorithm, which is named Bayesian tensor analysis (BTA). Theoretically, BTA can automatically and suitably determine dimensionality for different modalities of tensor data. With BTA. a collection of 3-D faces can be well modeled. Empirical studies on expression retargeting also justify the advantages of BTA.
引用
收藏
页码:1397 / 1410
页数:14
相关论文
共 38 条
[1]  
[Anonymous], 2007, P IEEE 11 INT C COMP
[2]   Algorithm 862: MATLAB tensor classes for fast algorithm prototyping [J].
Bader, Brett W. ;
Kolda, Tamara G. .
ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2006, 32 (04) :635-653
[3]  
BADER BW, 2006, SAND20067592 SAND NA
[4]  
BISHOP CM, 1996, ADV NEURAL INFORM PR, V9, P382
[5]  
Bishop CM., 1995, Neural networks for pattern recognition
[6]   A PROCEDURE FOR DETERMINING RIGID-BODY TRANSFORMATION PARAMETERS [J].
CHALLIS, JH .
JOURNAL OF BIOMECHANICS, 1995, 28 (06) :733-737
[7]  
DAI G, 2006, P NAT C ART INT, P330
[8]  
Ekman P., 1978, Facial action coding system: manual
[9]   M-face-: An appearance-based photorealistic model for multiple facial attributes rendering [J].
Fu, Yun ;
Zheng, Nanning .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (07) :830-842
[10]   Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence [J].
Gao, W ;
Chen, YQ ;
Wang, R ;
Shan, SG ;
Jiang, DL .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2003, 13 (11) :1119-1128