Virtual agent multimodal mimicry of humans

被引:25
作者
Caridakis, George [1 ]
Raouzaiou, Amaryllis [1 ]
Bevacqua, Elisabetta [2 ]
Mancini, Maurizio [2 ]
Karpouzis, Kostas [1 ]
Malatesta, Lori [1 ]
Pelachaud, Catherine [2 ]
机构
[1] Natl Tech Univ Athens, Image Video & Multimedia Syst Lab, Athens, Greece
[2] Univ Paris 08, LINC, IUT Montreuil, Paris, France
关键词
emotional ECA synthesis; expressivity features; facial features extraction; gesture analysis; virtual agents;
D O I
10.1007/s10579-007-9057-1
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
This work is about multimodal and expressive synthesis on virtual agents, based on the analysis of actions performed by human users. As input we consider the image sequence of the recorded human behavior. Computer vision and image processing techniques are incorporated in order to detect cues needed for expressivity features extraction. The multimodality of the approach lies in the fact that both facial and gestural aspects of the user's behavior are analyzed and processed. The mimicry consists of perception, interpretation, planning and animation of the expressions shown by the human, resulting not in an exact duplicate rather than an expressive model of the user's original behavior.
引用
收藏
页码:367 / 388
页数:22
相关论文
共 35 条
[1]   THIN SLICES OF EXPRESSIVE BEHAVIOR AS PREDICTORS OF INTERPERSONAL CONSEQUENCES - A METAANALYSIS [J].
AMBADY, N ;
ROSENTHAL, R .
PSYCHOLOGICAL BULLETIN, 1992, 111 (02) :256-274
[2]  
[Anonymous], 2005, VOCAL EXPRESSION AFF
[3]  
BAENZIGER T, 2006, P LREC 06 WORKSH COR, P15
[4]  
BYUN M, 2002, S COMPUTER ANIMATION
[5]  
CARIDAKIS G, 2007, P 4 IFIP C ART INT A
[6]  
CARIDAKIS G, 2006, INT C MULT INT ICMI
[7]  
Chartrand TL., 2005, The new unconscious, P334
[8]  
Chi D, 2000, COMP GRAPH, P173, DOI 10.1145/344779.352172
[9]  
Collins R., 1984, Approaches to Emotion, P385
[10]   Classifying facial actions [J].
Donato, G ;
Bartlett, MS ;
Hager, JC ;
Ekman, P ;
Sejnowski, TJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1999, 21 (10) :974-989