Speech driven facial animation using a hidden Markov coarticulation model

被引:11
作者
Cosker, D [1 ]
Marshall, D [1 ]
Rosin, PL [1 ]
Hicks, Y [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci, Cardiff CF24 3XF, S Glam, Wales
来源
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1 | 2004年
关键词
D O I
10.1109/ICPR.2004.1334024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a hierarchical image based facial model which is driven from speech. It incorporates a novel modelling and synthesis algorithm for learning and producing coarticulated mouth animation We demonstrate using the hierarchical model how animation of the entire face may be created solely from animations of the mouth and how colour may be reincorporated and reproduced compactly without explicitly being modelled. We then consider and evaluate methods of merging animations from several different facial areas for delivery of output.
引用
收藏
页码:128 / 131
页数:4
相关论文
共 7 条
[1]  
Brand M, 1999, COMP GRAPH, P21, DOI 10.1145/311535.311537
[2]   Active appearance models [J].
Cootes, TF ;
Edwards, GJ ;
Taylor, CJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) :681-685
[3]  
Cosker D. P., 2003, P MIRAGE, P20
[4]  
Deller J.R., 1993, Discrete-time processing of speech signals
[5]   Speechreading using probabilistic models [J].
Luettin, J ;
Thacker, NA .
COMPUTER VISION AND IMAGE UNDERSTANDING, 1997, 65 (02) :163-178
[6]   A SIMPLEX-METHOD FOR FUNCTION MINIMIZATION [J].
NELDER, JA ;
MEAD, R .
COMPUTER JOURNAL, 1965, 7 (04) :308-313
[7]   A TUTORIAL ON HIDDEN MARKOV-MODELS AND SELECTED APPLICATIONS IN SPEECH RECOGNITION [J].
RABINER, LR .
PROCEEDINGS OF THE IEEE, 1989, 77 (02) :257-286