A nonparametric regression model for virtual humans generation

被引:2
作者
Chou, Yun-Feng [1 ]
Shih, Zen-Chung [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Comp Sci, Hsinchu, Taiwan
关键词
Image deformation; Nonparametric regression; Elliptic radial basis functions; Functional approximation; Locally weighted regression; IMAGE; SPEECH; MOTION;
D O I
10.1007/s11042-009-0412-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a novel nonparametric regression model to generate virtual humans from still images for the applications of next generation environments (NG). This model automatically synthesizes deformed shapes of characters by using kernel regression with elliptic radial basis functions (ERBFs) and locally weighted regression (LOESS). Kernel regression with ERBFs is used for representing the deformed character shapes and creating lively animated talking faces. For preserving patterns within the shapes, LOESS is applied to fit the details with local control. The results show that our method effectively simulates plausible movements for character animation, including body movement simulation, novel views synthesis, and expressive facial animation synchronized with input speech. Therefore, the proposed model is especially suitable for intelligent multimedia applications in virtual humans generation.
引用
收藏
页码:163 / 187
页数:25
相关论文
共 51 条
[1]  
Alexa M, 2000, COMP GRAPH, P157, DOI 10.1145/344779.344859
[2]  
[Anonymous], 2012, INTRO LINEAR REGRESS
[3]  
[Anonymous], IEEE C COMP VIS PATT
[4]  
[Anonymous], 1999, Level Set Methods and Fast Marching Methods: Evolving Interfaces in Computational Geometry, Fluid Mechanics, Computer Vision, and Materials Science
[5]  
[Anonymous], ICCV, DOI DOI 10.1109/ICCV.2007.4408903
[6]   IMAGE WARPING BY RADIAL BASIS FUNCTIONS - APPLICATION TO FACIAL EXPRESSIONS [J].
ARAD, N ;
DYN, N ;
REISFELD, D ;
YESHURUN, Y .
CVGIP-GRAPHICAL MODELS AND IMAGE PROCESSING, 1994, 56 (02) :161-172
[7]   Reanimating faces in images and video [J].
Blanz, V ;
Basso, C ;
Poggio, T ;
Vetter, T .
COMPUTER GRAPHICS FORUM, 2003, 22 (03) :641-650
[8]   On linear variational surface deformation methods [J].
Botsch, Mario ;
Sorkine, Olga .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2008, 14 (01) :213-230
[9]  
Brand M, 1999, COMP GRAPH, P21, DOI 10.1145/311535.311537
[10]  
BRUCE HT, 1995, 8 ACM S US INT SOFTW, P3