Online Modeling For Realtime Facial Animation

被引：186

作者：

Bouaziz, Sofien ^{[1
]}

Wang, Yangang ^{[2
]}

Pauly, Mark ^{[1
]}

机构：

[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland

[2] Tsinghua Univ, EPFL, Beijing, Peoples R China

来源：

ACM TRANSACTIONS ON GRAPHICS | 2013年 / 32卷 / 04期

基金：

瑞士国家科学基金会;

关键词：

markerless performance capture; face animation; realtime tracking; blendshape animation; CAPTURE;

D O I：

10.1145/2461912.2461976

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present a new algorithm for realtime face tracking on commodity RGB-D sensing devices. Our method requires no user-specific training or calibration, or any other form of manual assistance, thus enabling a range of new applications in performance-based facial animation and virtual interaction at the consumer level. The key novelty of our approach is an optimization algorithm that jointly solves for a detailed 3D expression model of the user and the corresponding dynamic tracking parameters. Realtime performance and robust computations are facilitated by a novel subspace parameterization of the dynamic facial expression space. We provide a detailed evaluation that shows that our approach significantly simplifies the performance capture workflow, while achieving accurate facial tracking for realtime applications.

引用

页数：9

共 28 条

[1] Amberg B, 2009, PROC CVPR IEEE, P1714, DOI 10.1109/CVPRW.2009.5206788
[2] [Anonymous], 2004, Technical Report
[3] [Anonymous], 1994, TEMPLATES SOLUTION L, DOI DOI 10.1137/1.9781611971538
[4] [Anonymous], 2009, P 2009 ACM SIGGRAPHE, DOI [DOI 10.1145/1599470.1599472, 10.1145/1599470.1599472]
[5] Baltrusaitis T, 2012, PROC CVPR IEEE, P2610, DOI 10.1109/CVPR.2012.6247980
[6] High-Quality Passive Facial Performance Capture using Anchor Frames
Beeler, Thabo
Hahn, Fabian
Bradley, Derek
Bickel, Bernd
Beardsley, Paul
Gotsman, Craig
Sumner, Robert W.
Gross, Markus
[J]. ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (04):
[7] Bickel Bernd, 2008, Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '08, P57
[8] A morphable model for the synthesis of 3D faces
Blanz, V
Vetter, T
[J]. SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, : 187 - 194
[9] Botsch M, 2006, Vision, modeling & visualization, P357
[10] Botsch Mario, 2010, Polygon Mesh Processing, DOI DOI 10.1201/B10688

← 1 2 3 →