Interactive facial expression editing based on spatio-temporal coherency

被引:6
作者
Chi, Jing [1 ]
Gao, Shanshan [1 ]
Zhang, Caiming [1 ]
机构
[1] Shandong Univ Finance & Econ, Dept Comp Sci & Technol, Jinan, Peoples R China
关键词
Facial animation; Editing; Spatio-temporal motion; Adaptive segmentation; CAPTURE;
D O I
10.1007/s00371-017-1387-4
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a novel approach for interactively and intuitively editing 3D facial animation in this paper. It determines a new expression by combining the user-specified constraints with the priors contained in a pre-recorded facial expression set, which effectively overcomes the generation of an unnatural expression caused by only user-constraints. The approach is based on the framework of example-based linear interpolation. It adaptively segments the face model into soft regions based on user-interaction. In dependently modeling each region, we propose a new function to estimate the blending weight of each example that matches the user-constraints as well as the spatio-temporal properties of the face set. In blending the regions into a single expression, we present a new criterion that fully exploits the spatial proximity and the spatio-temporal motion consistency over the face set to measure the coherency between vertices and use the coherency to reasonably propagate the influence of each region to the entire face model. Experiments show that our approach, even with inappropriate user's edits, can create a natural expression that optimally satisfies the user-desired goal.
引用
收藏
页码:981 / 991
页数:11
相关论文
共 22 条
[1]  
Acquaah K., 2015, IEEE INT C EL COMP C, P1
[2]   Bilinear Spatiotemporal Basis Models [J].
Akhter, Ijaz ;
Simon, Tomas ;
Khan, Sohaib ;
Matthews, Iain ;
Sheikh, Yaser .
ACM TRANSACTIONS ON GRAPHICS, 2012, 31 (02) :1-12
[3]   A morphable model for the synthesis of 3D faces [J].
Blanz, V ;
Vetter, T .
SIGGRAPH 99 CONFERENCE PROCEEDINGS, 1999, :187-194
[4]  
Cetinaslan O., 2015, EG
[5]  
Jin-xiang Chai, 2003, ACM SIGGRAPH/Eurographics Symposium on Computer Animation, P193
[6]  
Joshi P., 2003, SCA'03: Proc. of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, P35
[7]   Face Poser: Interactive Modeling of 3D Facial Expressions Using Facial Priors [J].
Lau, Manfred ;
Chai, Jinxiang ;
Xu, Ying-Qing ;
Shum, Heung-Yeung .
ACM TRANSACTIONS ON GRAPHICS, 2009, 29 (01)
[8]   Direct-Manipulation Blendshapes [J].
Lewis, J. P. ;
Anjyo, Ken .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2010, 30 (04) :42-50
[9]  
Lewis JP, 2000, COMP GRAPH, P165, DOI 10.1145/344779.344862
[10]   Orthogonal-Blendshape-Based Editing System for Facial Motion Capture Data [J].
Li, Qing ;
Deng, Zhigang .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2008, 28 (06) :76-82