How visual cues to speech rate influence speech perception

被引:5
作者
Bosker, Hans Rutger [1 ,2 ]
Peeters, David [1 ,2 ,3 ]
Holler, Judith [1 ,2 ]
机构
[1] Max Planck Inst Psycholinguist, POB 310, NL-6500 AH Nijmegen, Netherlands
[2] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, Nijmegen, Netherlands
[3] Tilburg Univ, Tilburg Ctr Cognit & Commun TiCC, Dept Commun & Cognit, Tilburg, Netherlands
关键词
Speech rate; neural entrainment; audiovisual speech perception; rate-dependent perception; rate normalisation; supramodal perception; SPEAKING RATE; AUDITORY-CORTEX; INFORMATION; OSCILLATIONS; HEARING; WORDS;
D O I
10.1177/1747021820914564
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Spoken words are highly variable and therefore listeners interpret speech sounds relative to the surrounding acoustic context, such as the speech rate of a preceding sentence. For instance, a vowel midway between short /a:/ and long /a:/ in Dutch is perceived as short /./ in the context of preceding slow speech, but as long /a:/ if preceded by a fast context. Despite the well-established influence of visual articulatory cues on speech comprehension, it remains unclear whether visual cues to speech rate also influence subsequent spoken word recognition. In two "Go Fish"-like experiments, participants were presented with audio-only (auditory speech + fixation cross), visual-only (mute videos of talking head), and audiovisual (speech + videos) context sentences, followed by ambiguous target words containing vowels midway between short /./ and long /a:/. In Experiment 1, target words were always presented auditorily, without visual articulatory cues. Although the audio-only and audiovisual contexts induced a rate effect (i.e., more long /a:/ responses after fast contexts), the visual-only condition did not. When, in Experiment 2, target words were presented audiovisually, rate effects were observed in all three conditions, including visual-only. This suggests that visual cues to speech rate in a context sentence influence the perception of following visual target cues (e.g., duration of lip aperture), which at an audiovisual integration stage bias participants' target categorisation responses. These findings contribute to a better understanding of how what we see influences what we hear.
引用
收藏
页码:1523 / 1536
页数:14
相关论文
共 55 条
  • [1] Talker information influences spectral contrast effects in speech categorization
    Assgari, Ashley A.
    Stilp, Christian E.
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 2015, 138 (05) : 3023 - 3032
  • [2] Fitting Linear Mixed-Effects Models Using lme4
    Bates, Douglas
    Maechler, Martin
    Bolker, Benjamin M.
    Walker, Steven C.
    [J]. JOURNAL OF STATISTICAL SOFTWARE, 2015, 67 (01): : 1 - 48
  • [3] Visual recalibration of auditory speech identification: A McGurk aftereffect
    Bertelson, P
    Vroomen, J
    de Gelder, B
    [J]. PSYCHOLOGICAL SCIENCE, 2003, 14 (06) : 592 - 597
  • [4] Speaker's hand gestures modulate speech perception through phase resetting of ongoing neural oscillations
    Biau, Emmanuel
    Torralba, Mireia
    Fuentemilla, Lluis
    Balaguer, Ruth de Diego
    Soto-Faraco, Salvador
    [J]. CORTEX, 2015, 68 : 76 - 85
  • [5] Boersma P, 2016, PRAAT DOING PHONETIC
  • [6] Spectral contrast effects are modulated by selective attention in "cocktail party" settings
    Bosker, Hans Rutger
    Sjerps, Matthias J.
    Reinisch, Eva
    [J]. ATTENTION PERCEPTION & PSYCHOPHYSICS, 2020, 82 (03) : 1318 - 1332
  • [7] Entrained theta oscillations guide perception of subsequent speech: behavioural evidence from rate normalisation
    Bosker, Hans Rutger
    Ghitza, Oded
    [J]. LANGUAGE COGNITION AND NEUROSCIENCE, 2018, 33 (08) : 955 - 967
  • [8] How Our Own Speech Rate Influences Our Perception of Others
    Bosker, Hans Rutger
    [J]. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-LEARNING MEMORY AND COGNITION, 2017, 43 (08) : 1225 - 1238
  • [9] Foreign Languages Sound Fast: Evidence from Implicit Rate Normalization
    Bosker, Hans Rutger
    Reinisch, Eva
    [J]. FRONTIERS IN PSYCHOLOGY, 2017, 8
  • [10] Cognitive load makes speech sound fast, but does not modulate acoustic context effects
    Bosker, Hans Rutger
    Reinisch, Eva
    Sjerps, Matthias J.
    [J]. JOURNAL OF MEMORY AND LANGUAGE, 2017, 94 : 166 - 176