How visual cues to speech rate influence speech perception

被引:5
作者
Bosker, Hans Rutger [1 ,2 ]
Peeters, David [1 ,2 ,3 ]
Holler, Judith [1 ,2 ]
机构
[1] Max Planck Inst Psycholinguist, POB 310, NL-6500 AH Nijmegen, Netherlands
[2] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
[3] Tilburg Univ, Tilburg Ctr Cognit & Commun TiCC, Dept Commun & Cognit, Tilburg, Netherlands
关键词
Speech rate; neural entrainment; audiovisual speech perception; rate-dependent perception; rate normalisation; supramodal perception; SPEAKING RATE; AUDITORY-CORTEX; INFORMATION; OSCILLATIONS; HEARING; WORDS;
D O I
10.1177/1747021820914564
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Spoken words are highly variable and therefore listeners interpret speech sounds relative to the surrounding acoustic context, such as the speech rate of a preceding sentence. For instance, a vowel midway between short /a:/ and long /a:/ in Dutch is perceived as short /./ in the context of preceding slow speech, but as long /a:/ if preceded by a fast context. Despite the well-established influence of visual articulatory cues on speech comprehension, it remains unclear whether visual cues to speech rate also influence subsequent spoken word recognition. In two "Go Fish"-like experiments, participants were presented with audio-only (auditory speech + fixation cross), visual-only (mute videos of talking head), and audiovisual (speech + videos) context sentences, followed by ambiguous target words containing vowels midway between short /./ and long /a:/. In Experiment 1, target words were always presented auditorily, without visual articulatory cues. Although the audio-only and audiovisual contexts induced a rate effect (i.e., more long /a:/ responses after fast contexts), the visual-only condition did not. When, in Experiment 2, target words were presented audiovisually, rate effects were observed in all three conditions, including visual-only. This suggests that visual cues to speech rate in a context sentence influence the perception of following visual target cues (e.g., duration of lip aperture), which at an audiovisual integration stage bias participants' target categorisation responses. These findings contribute to a better understanding of how what we see influences what we hear.
引用
收藏
页码:1523 / 1536
页数:14
相关论文
共 55 条
[1]   Talker information influences spectral contrast effects in speech categorization [J].
Assgari, Ashley A. ;
Stilp, Christian E. .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (05) :3023-3032
[2]   Fitting Linear Mixed-Effects Models Using lme4 [J].
Bates, Douglas ;
Maechler, Martin ;
Bolker, Benjamin M. ;
Walker, Steven C. .
JOURNAL OF STATISTICAL SOFTWARE, 2015, 67 (01) :1-48
[3]   Visual recalibration of auditory speech identification: A McGurk aftereffect [J].
Bertelson, P ;
Vroomen, J ;
de Gelder, B .
PSYCHOLOGICAL SCIENCE, 2003, 14 (06) :592-597
[4]   Speaker's hand gestures modulate speech perception through phase resetting of ongoing neural oscillations [J].
Biau, Emmanuel ;
Torralba, Mireia ;
Fuentemilla, Lluis ;
Balaguer, Ruth de Diego ;
Soto-Faraco, Salvador .
CORTEX, 2015, 68 :76-85
[5]  
Boersma P., 2020, Praat: Doing phonetics by computer
[6]   Spectral contrast effects are modulated by selective attention in "cocktail party" settings [J].
Bosker, Hans Rutger ;
Sjerps, Matthias J. ;
Reinisch, Eva .
ATTENTION PERCEPTION & PSYCHOPHYSICS, 2020, 82 (03) :1318-1332
[7]   Entrained theta oscillations guide perception of subsequent speech: behavioural evidence from rate normalisation [J].
Bosker, Hans Rutger ;
Ghitza, Oded .
LANGUAGE COGNITION AND NEUROSCIENCE, 2018, 33 (08) :955-967
[8]   How Our Own Speech Rate Influences Our Perception of Others [J].
Bosker, Hans Rutger .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2017, 43 (08) :1225-1238
[9]   Foreign Languages Sound Fast: Evidence from Implicit Rate Normalization [J].
Bosker, Hans Rutger ;
Reinisch, Eva .
FRONTIERS IN PSYCHOLOGY, 2017, 8
[10]   Cognitive load makes speech sound fast, but does not modulate acoustic context effects [J].
Bosker, Hans Rutger ;
Reinisch, Eva ;
Sjerps, Matthias J. .
JOURNAL OF MEMORY AND LANGUAGE, 2017, 94 :166-176