Online Modeling For Realtime Facial Animation

被引：196

作者：

Bouaziz, Sofien ^{[1
]}

Wang, Yangang ^{[2
]}

Pauly, Mark ^{[1
]}

机构：

[1] Ecole Polytech Fed Lausanne, Lausanne, Switzerland

[2] Tsinghua Univ, EPFL, Beijing, Peoples R China

来源：

ACM TRANSACTIONS ON GRAPHICS | 2013年 / 32卷 / 04期

基金：

瑞士国家科学基金会;

关键词：

markerless performance capture; face animation; realtime tracking; blendshape animation; CAPTURE;

D O I：

10.1145/2461912.2461976

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present a new algorithm for realtime face tracking on commodity RGB-D sensing devices. Our method requires no user-specific training or calibration, or any other form of manual assistance, thus enabling a range of new applications in performance-based facial animation and virtual interaction at the consumer level. The key novelty of our approach is an optimization algorithm that jointly solves for a detailed 3D expression model of the user and the corresponding dynamic tracking parameters. Realtime performance and robust computations are facilitated by a novel subspace parameterization of the dynamic facial expression space. We provide a detailed evaluation that shows that our approach significantly simplifies the performance capture workflow, while achieving accurate facial tracking for realtime applications.

引用

页数：9

共 28 条

[1]

Amberg B, 2009, PROC CVPR IEEE, P1714, DOI 10.1109/CVPRW.2009.5206788

[2]

[Anonymous], 2004, Technical Report

[3]

[Anonymous], 1994, TEMPLATES SOLUTION L, DOI DOI 10.1137/1.9781611971538

[4]

[Anonymous], 2009, P 2009 ACM SIGGRAPHE, DOI [DOI 10.1145/1599470.1599472, 10.1145/1599470.1599472]

[5]

Baltrusaitis T, 2012, PROC CVPR IEEE, P2610, DOI 10.1109/CVPR.2012.6247980

[6] High-Quality Passive Facial Performance Capture using Anchor Frames [J].

Beeler, Thabo ;

Hahn, Fabian ;

Bradley, Derek ;

Bickel, Bernd ;

Beardsley, Paul ;

Gotsman, Craig ;

Sumner, Robert W. ;

Gross, Markus .

ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (04)

[7]

Bickel Bernd, 2008, Proceedings of the 2008 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, SCA '08, P57

[8] A morphable model for the synthesis of 3D faces [J].

Blanz, V ;

Vetter, T .

SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194

[9]

Botsch M, 2006, Vision, modeling & visualization, P357

[10]

Botsch Mario, 2010, Polygon Mesh Processing, DOI DOI 10.1201/B10688

← 1 2 3 →