The perception of emotions by ear and by eye

被引:459
作者
de Gelder, B
Vroomen, J
机构
[1] Tilburg Univ, Dept Psychol, NL-5000 LE Tilburg, Netherlands
[2] Free Univ Brussels, B-1050 Brussels, Belgium
基金
澳大利亚研究理事会;
关键词
D O I
10.1080/026999300378824
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Emotions are expressed in the voice as well as on the face. As a first step to explore the question of their integration, we used a bimodal perception situation modelled after the McGurk paradigm, in which varying degrees of discordance can be created between the affects expressed in a face and in a tone of voice. Experiment I showed that subjects can effectively combine information from the two sources, in that identification of the emotion in the face is biased in the direction of the simultaneously presented tone of voice. Experiment 2 showed that this effect occurs also under instructions to base the judgement exclusively on the face. Experiment 3 showed the reverse effect, a bias from the emotion in the face on judgement of the emotion in the voice. These results strongly suggest the existence of mandatory bidirectional links between affect detection structures in vision and audition.
引用
收藏
页码:289 / 311
页数:23
相关论文
共 56 条
[1]  
Anderson AK, 1998, NEUROREPORT, V9, P3607
[2]  
[Anonymous], 1996, The Emotional Brain
[3]  
BENSON P J, 1991, European Journal of Cognitive Psychology, V3, P105, DOI 10.1080/09541449108406222
[4]  
BERTELSON P, 1998, ADV PSYCHOL SCI, V1
[5]   CHILD VERSUS ADULT PERCEPTION OF EVALUATIVE MESSAGES IN VERBAL, VOCAL, AND VISUAL CHANNELS [J].
BUGENTAL, DE ;
KASWAN, JW ;
LOVE, LR ;
FOX, MN .
DEVELOPMENTAL PSYCHOLOGY, 1970, 2 (03) :367-375
[6]  
Campbell R, 1996, ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, P1493, DOI 10.1109/ICSLP.1996.607899
[7]  
CARLSON R, 1992, P ICSLP 92 BANFF ALB, V1, P671
[8]  
Charpentier F, 1989, P EUROSPEECH 89, P13
[10]   ANALYSIS OF THE GLOTTAL EXCITATION OF EMOTIONALLY STYLED AND STRESSED SPEECH [J].
CUMMINGS, KE ;
CLEMENTS, MA .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1995, 98 (01) :88-98