Video-driven state-aware facial animation

被引:11
作者
Zeng, Ming [1 ]
Liang, Lin [2 ]
Liu, Xinguo [1 ]
Bao, Hujun [1 ]
机构
[1] Zhejiang Univ, State Key Lab CAD & CG, Hangzhou 310003, Zhejiang, Peoples R China
[2] Microsoft Corp, Seattle, WA USA
关键词
facial animation; face state recognition; video-driven animation; state-aware face action estimation;
D O I
10.1002/cav.1455
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
It is important in computer animation to synthesize expressive facial animation for avatars from videos. Some traditional methods track a set of semantic feature points on the face to drive the avatar. However, these methods usually suffer from inaccurate detection and sparseness of the feature points and fail to obtain high-level understanding of facial expressions, leading to less expressive and even wrong expressions on the avatar. In this paper, we propose a state-aware synthesis framework. Instead of simply fitting 3D face to the 2D feature points, we use expression states obtained by a set of low-cost classifiers?(based on local binary pattern and support vector machine) on the face texture to guide the face fitting procedure. Our experimental results show that the proposed hybrid framework enjoys the advantages of the original methods based on feature point and the awareness of the expression states of the classifiers and thus vivifies and enriches the face expressions of the avatar. Copyright (C) 2012 John Wiley & Sons, Ltd.
引用
收藏
页码:167 / 178
页数:12
相关论文
共 32 条
  • [1] Ahlberg J., 2001, CANDIDE-3 -- an updated parameterized face
  • [2] [Anonymous], 2006, Pattern recognition and machine learning
  • [3] A morphable model for the synthesis of 3D faces
    Blanz, V
    Vetter, T
    [J]. SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, : 187 - 194
  • [4] Cai Q, 2010, LECT NOTES COMPUT SC, V6313, P229
  • [5] Mood swings: Expressive speech animation
    Chuang, E
    Bregler, C
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2005, 24 (02): : 331 - 347
  • [6] Chuang E, 2002, SUCSTR200202
  • [7] Optical flow constraints on deformable models with applications to face tracking
    DeCarlo, D
    Metaxas, D
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2000, 38 (02) : 99 - 127
  • [8] Deng Z., 2006, Proc. of ACM SIGGGRAPH/Eurographics Symposium on Computer Animation, P251
  • [9] Deng Z.et., 2008, Proc. of 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, P67
  • [10] Ekman P, 1994, NATURE EMOTIONL FUND