Evidence for a Causal Dissociation of the McGurk Effect and Congruent Audiovisual Speech Perception via TMS to the Left pSTS

被引:0
作者
Ahn, Eunseon [1 ]
Majumdar, Areti [1 ]
Lee, Taraz G. [1 ]
Brang, David [1 ]
机构
[1] Univ Michigan, Dept Psychol, Ann Arbor, MI 48109 USA
关键词
audiovisual; language; multisensory; speech; TMS; TRANSCRANIAL MAGNETIC STIMULATION; VISUAL SPEECH; INTERINDIVIDUAL DIFFERENCES; GAZE BEHAVIOR; HEARING-LIPS; INTEGRATION; POWER; OSCILLATIONS; ACTIVATION; PREDICTION;
D O I
10.1163/22134808-bja10129
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
Congruent visual speech improves speech perception accuracy, particularly in noisy environments. Conversely, mismatched visual speech can alter what is heard, leading to an illusory percept that differs from the auditory and visual components, known as the McGurk effect. While prior transcranial magnetic stimulation (TMS) and neuroimaging studies have identified the left posterior superior temporal sulcus (pSTS) as a causal region involved in the generation of the McGurk effect, it remains unclear whether this region is critical only for this illusion or also for the more general benefits of congruent visual speech (e.g., increased accuracy and faster reaction times). Indeed, recent correlative research suggests that the benefits of congruent visual speech and the McGurk effect rely on largely independent mechanisms. To better understand how these different features of audiovisual integration are causally generated by the left pSTS, we used single-pulse TMS to temporarily disrupt processing within this region while subjects were presented with either congruent or incongruent (McGurk) audiovisual combinations. Consistent with past research, we observed that TMS to the left pSTS reduced the strength of the McGurk effect. Importantly, however, left pSTS stimulation had no effect on the positive benefits of congruent audiovisual speech (increased accuracy and faster reaction times), demonstrating a causal dissociation between the two processes. Our results are consistent with models proposing that the pSTS is but one of multiple critical areas supporting audiovisual speech interactions. Moreover, these data add to a growing body of evidence suggesting that the McGurk effect is an imperfect surrogate measure for more general and ecologically valid audiovisual speech behaviors.
引用
收藏
页码:341 / 363
页数:23
相关论文
共 74 条
[1]   Attention to touch weakens audiovisual speech integration [J].
Alsius, Agnes ;
Navarra, Jordi ;
Soto-Faraco, Salvador .
EXPERIMENTAL BRAIN RESEARCH, 2007, 183 (03) :399-404
[2]   Forty Years After Hearing Lips and Seeing Voices: the McGurk Effect Revisited [J].
Alsius, Agnes ;
Pare, Martin ;
Munhall, Kevin G. .
MULTISENSORY RESEARCH, 2018, 31 (1-2) :111-144
[3]   High visual resolution matters in audiovisual speech perception, but only for some [J].
Alsius, Agnes ;
Wayne, Rachel V. ;
Pare, Martin ;
Munhall, Kevin G. .
ATTENTION PERCEPTION & PSYCHOPHYSICS, 2016, 78 (05) :1472-1487
[4]   Transitions in neural oscillations reflect prediction errors generated in audiovisual speech [J].
Arnal, Luc H. ;
Wyart, Valentin ;
Giraud, Anne-Lise .
NATURE NEUROSCIENCE, 2011, 14 (06) :797-U164
[5]   Dual Neural Routing of Visual Facilitation in Speech Processing [J].
Arnal, Luc H. ;
Morillon, Benjamin ;
Kell, Christian A. ;
Giraud, Anne-Lise .
JOURNAL OF NEUROSCIENCE, 2009, 29 (43) :13445-13453
[6]   Variability and stability in the McGurk effect: contributions of participants, stimuli, time, and response type [J].
Basu Mallick, Debshila ;
Magnotti, John F. ;
Beauchamp, Michael S. .
PSYCHONOMIC BULLETIN & REVIEW, 2015, 22 (05) :1299-1307
[7]   fMRI-Guided Transcranial Magnetic Stimulation Reveals That the Superior Temporal Sulcus Is a Cortical Locus of the McGurk Effect [J].
Beauchamp, Michael S. ;
Nath, Audrey R. ;
Pasalar, Siavash .
JOURNAL OF NEUROSCIENCE, 2010, 30 (07) :2414-2417
[8]   Primary and Multisensory Cortical Activity is Correlated with Audiovisual Percepts [J].
Benoit, Margo McKenna ;
Raij, Tommi ;
Lin, Fa-Hsuan ;
Jaaskelainen, Iiro P. ;
Stufflebeam, Steven .
HUMAN BRAIN MAPPING, 2010, 31 (04) :526-538
[9]   Quantified acoustic-optical speech signal incongruity identifies cortical sites of audiovisual speech processing [J].
Bernstein, Lynne E. ;
Lu, Zhong-Lin ;
Jiang, Jintao .
BRAIN RESEARCH, 2008, 1242 :172-184
[10]   Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans [J].
Besle, Julien ;
Fischer, Catherine ;
Bidet-Caulet, Aurelie ;
Lecaignard, Francoise ;
Bertrand, Olivier ;
Giard, Marie-Helene .
JOURNAL OF NEUROSCIENCE, 2008, 28 (52) :14301-14310