When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception

被引:21
|
作者
Jordan, Timothy R. [1 ]
Thomas, Sharon M. [1 ]
机构
[1] Univ Leicester, Coll Med Biol Sci & Psychol, Leicester LE1 9HN, Leics, England
关键词
Speech perception; Face perception; Hearing; Audiovisual speech; McGurk effect; WORD RECOGNITION; MOUTH ASYMMETRY; LIPS; DISCRIMINATION; ASSOCIATION; EVOLUTION; MOVEMENT; LAUGHTER; OBJECTS; VISION;
D O I
10.3758/s13414-011-0152-4
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The visible movement of a talker's face is an influential component of speech perception. However, the ability of this influence to function when large areas of the face (similar to 50%) are covered by simple substantial occlusions, and so are not visible to the observer, has yet to be fully determined. In Experiment 1, both visual speech identification and the influence of visual speech on identifying congruent and incongruent auditory speech were investigated using displays of a whole (unoccluded) talking face and of the same face occluded vertically so that the entire left or right hemiface was covered. Both the identification of visual speech and its influence on auditory speech perception were identical across all three face displays. Experiment 2 replicated and extended these results, showing that visual and audiovisual speech perception also functioned well with other simple substantial occlusions (horizontal and diagonal). Indeed, displays in which entire upper facial areas were occluded produced performance levels equal to those obtained with unoccluded displays. Occluding entire lower facial areas elicited some impairments in performance, but visual speech perception and visual speech influences on auditory speech perception were still apparent. Finally, implications of these findings for understanding the processes supporting visual and audiovisual speech perception are discussed.
引用
收藏
页码:2270 / 2285
页数:16
相关论文
共 2 条