Audiovisual Speech Integration Does Not Rely on the Motor System: Evidence from Articulatory Suppression, the McGurk Effect, and fMRI

被引:34
作者
Matchin, William [1 ]
Groulx, Kier [1 ]
Hickok, Gregory [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
基金
美国国家卫生研究院;
关键词
SUPERIOR TEMPORAL SULCUS; MULTISENSORY INTEGRATION; HEARING LIPS; PERCEPTION; CORTEX; CONNECTIONS; ACTIVATION; MODEL; STILL; FACES;
D O I
10.1162/jocn_a_00515
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Visual speech influences the perception of heard speech. A classic example of this is the McGurk effect, whereby an auditory /pa/ overlaid onto a visual /ka/ induces the fusion percept of /ta/. Recent behavioral and neuroimaging research has highlighted the importance of both articulatory representations and motor speech regions of the brain, particularly Broca's area, in audiovisual (AV) speech integration. Alternatively, AV speech integration may be accomplished by the sensory system through multisensory integration in the posterior STS. We assessed the claims regarding the involvement of the motor system in AV integration in two experiments: (i) examining the effect of articulatory suppression on the McGurk effect and (ii) determining if motor speech regions show an AV integration profile. The hypothesis regarding experiment (i) is that if the motor system plays a role in McGurk fusion, distracting the motor system through articulatory suppression should result in a reduction of McGurk fusion. The results of experiment (i) showed that articulatory suppression results in no such reduction, suggesting that the motor system is not responsible for the McGurk effect. The hypothesis of experiment (ii) was that if the brain activation to AV speech in motor regions (such as Broca's area) reflects AV integration, the profile of activity should reflect AV integration: AV > AO (auditory only) and AV > VO (visual only). The results of experiment (ii) demonstrate that motor speech regions do not show this integration profile, whereas the posterior STS does. Instead, activity in motor regions is task dependent. The combined results suggest that AV speech integration does not rely on the motor system.
引用
收藏
页码:606 / 620
页数:15
相关论文
共 53 条
[1]   THE ROLE OF SUBVOCALIZATION IN READING [J].
BADDELEY, A ;
ELDRIDGE, M ;
LEWIS, V .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY, 1981, 33 (NOV) :439-454
[2]   fMRI-Guided Transcranial Magnetic Stimulation Reveals That the Superior Temporal Sulcus Is a Cortical Locus of the McGurk Effect [J].
Beauchamp, Michael S. ;
Nath, Audrey R. ;
Pasalar, Siavash .
JOURNAL OF NEUROSCIENCE, 2010, 30 (07) :2414-2417
[3]   Statistical criteria in fMRI studies of multisensory integration [J].
Beauchamp, MS .
NEUROINFORMATICS, 2005, 3 (02) :93-113
[4]   Unraveling multisensory integration: patchy organization within human STS multisensory cortex [J].
Beauchamp, MS ;
Argall, BD ;
Bodurka, J ;
Duyn, JH ;
Martin, A .
NATURE NEUROSCIENCE, 2004, 7 (11) :1190-1192
[5]   Integration of auditory and visual information about objects in superior temporal sulcus [J].
Beauchamp, MS ;
Lee, KE ;
Argall, BD ;
Martin, A .
NEURON, 2004, 41 (05) :809-823
[6]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[7]   Human dorsal and ventral auditory streams subserve rehearsal-based and echoic processes during verbal working memory [J].
Buchsbaum, BR ;
Olsen, RK ;
Koch, P ;
Berman, KF .
NEURON, 2005, 48 (04) :687-697
[8]   The brain's default network - Anatomy, function, and relevance to disease [J].
Buckner, Randy L. ;
Andrews-Hanna, Jessica R. ;
Schacter, Daniel L. .
YEAR IN COGNITIVE NEUROSCIENCE 2008, 2008, 1124 :1-38
[9]   Multisensory integration sites identified by perception of spatial wavelet filtered visual speech gesture information [J].
Callan, DE ;
Jones, JA ;
Munhall, K ;
Kroos, C ;
Callan, AM ;
Vatikiotis-Bateson, E .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2004, 16 (05) :805-816
[10]   Neural processes underlying perceptual enhancement by visual speech gestures [J].
Callan, DE ;
Jones, JA ;
Munhall, K ;
Callan, AM ;
Kroos, C ;
Vatikiotis-Bateson, E .
NEUROREPORT, 2003, 14 (17) :2213-2218