Towards Affective State Modeling in Narrative and Conversational Settings

被引:0
作者
Jochems, Bart [1 ]
Larson, Martha [2 ]
Ordelman, Roeland [1 ]
Poppe, Ronald [1 ]
Truong, Khiet P. [1 ]
机构
[1] Univ Twente, Human Media Interact Grp, Enschede, Netherlands
[2] Delft Univ Technol, Multimedia Informat Retrieval Lab, Delft, Netherlands
来源
11TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2010 (INTERSPEECH 2010), VOLS 1-2 | 2010年
关键词
affect; speech recognition; audio analysis; natural language communication; SPEECH RECOGNITION; LANGUAGE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We carry out two studies on affective state modeling for communication settings that involve unilateral intent on the part of one participant (the evoker) to shift the affective state of another participant (the experiencer). The first investigates viewer response in a narrative setting using a corpus of documentaries annotated with viewer-reported narrative peaks. The second investigates affective triggers in a conversational setting using a corpus of recorded interactions, annotated with continuous affective ratings, between a human interlocutor and an emotionally colored agent. In each case, we build a "one-sided" model using indicators derived from the speech of one participant. Our classification experiments confirm the viability of our models and provide insight into useful features. http://doc.utwente.nl/74046/1/IS100331.PDF
引用
收藏
页码:490 / +
页数:2
相关论文
共 18 条
[1]   Acoustic profiles in vocal emotion expression [J].
Banse, R ;
Scherer, KR .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1996, 70 (03) :614-636
[2]   TOWARD A PRAGMATICS OF EMOTIVE COMMUNICATION [J].
CAFFI, C ;
JANNEY, RW .
JOURNAL OF PRAGMATICS, 1994, 22 (3-4) :325-373
[3]   The secret life of pronouns: Flexibility in writing style and physical health [J].
Campbell, RS ;
Pennebaker, JW .
PSYCHOLOGICAL SCIENCE, 2003, 14 (01) :60-65
[4]  
Cowie R., P ISCA WORKSH SPEECH, p[19, 325]
[5]   Praat script to detect syllable nuclei and measure speech rate automatically [J].
de Jong, Nivja H. ;
Wempe, Ton .
BEHAVIOR RESEARCH METHODS, 2009, 41 (02) :385-390
[6]  
Hanjalic A., 2003, P INT C IM PROC, V1, P2
[7]  
Huang Z., 2006, P LANG RES EV C
[8]  
Huijbregts M, 2007, LECT NOTES COMPUT SC, V4816, P78
[9]  
Larson M., 2010, LNCS IN PRESS, V2
[10]   A framework for flexible summarization of racquet sports video using multiple modalities [J].
Liu, Chunxi ;
Huang, Qingming ;
Jiang, Shuqiang ;
Xing, Liyuan ;
Ye, Qixiang ;
Gao, Wen .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2009, 113 (03) :415-424