Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition

被引:181
作者
Stevenson, Ryan A. [1 ]
James, Thomas W. [1 ]
机构
[1] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN 47405 USA
关键词
Multisensory integration; Vision; Superadditivity; Perception; fMRI; Neuroimaging; Auditory; Speech perception; MULTISENSORY INTEGRATION; COLLICULUS NEURONS; PERCEPTION; ACTIVATION; CORTEX; FMRI; ORGANIZATION; BRAIN; EYE; DETERMINANTS;
D O I
10.1016/j.neuroimage.2008.09.034
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The superior temporal sulcus (STS) is a region involved in audiovisual integration. In non-human primates, multisensory neurons in STS display inverse effectiveness. In two fMRI studies using multisensory tool and speech stimuli presented at parametrically varied levels of signal strength, we show that the pattern of neural activation in human STS is also inversely effective. Although multisensory tool-defined and speechdefined regions of interest were non-overlapping, the pattern of inverse effectiveness was the same for tools and speech across regions. The findings suggest that, even though there are sub-regions in STS that are speech-selective, the manner in which visual and auditory signals are integrated in multisensory STS is not specific to speech. (C) 2008 Elsevier Inc. All rights reserved.
引用
收藏
页码:1210 / 1223
页数:14
相关论文
共 75 条
  • [1] Multisensory processing in "unimodal" neurons: Cross-modal subthreshold auditory effects in cat extrastriate visual cortex
    Allman, Brian L.
    Meredith, M. Alex
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (01) : 545 - 549
  • [2] [Anonymous], RES SPOKEN LANGUAGE
  • [3] [Anonymous], 1998, Perceiving talking faces: From speech perception to a behavioral principle, MIT Press/Bradford Books series in cognitive psychology
  • [4] [Anonymous], 1998, Research on Spoken Language Processing Progress Report No. 22
  • [5] Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions
    Barraclough, NE
    Xiao, DK
    Baker, CI
    Oram, MW
    Perrett, DI
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (03) : 377 - 391
  • [6] Statistical criteria in fMRI studies of multisensory integration
    Beauchamp, MS
    [J]. NEUROINFORMATICS, 2005, 3 (02) : 93 - 113
  • [7] Unraveling multisensory integration: patchy organization within human STS multisensory cortex
    Beauchamp, MS
    Argall, BD
    Bodurka, J
    Duyn, JH
    Martin, A
    [J]. NATURE NEUROSCIENCE, 2004, 7 (11) : 1190 - 1192
  • [8] Integration of auditory and visual information about objects in superior temporal sulcus
    Beauchamp, MS
    Lee, KE
    Argall, BD
    Martin, A
    [J]. NEURON, 2004, 41 (05) : 809 - 823
  • [9] AUDITORY-VISUAL INTERACTION IN SINGLE CELLS IN CORTEX OF SUPERIOR TEMPORAL SULCUS AND ORBITAL FRONTAL CORTEX OF MACAQUE MONKEY
    BENEVENTO, LA
    FALLON, J
    DAVIS, BJ
    REZAK, M
    [J]. EXPERIMENTAL NEUROLOGY, 1977, 57 (03) : 849 - 872
  • [10] Function of the left planum temporale in auditory and linguistic processing
    Binder, JR
    Frost, JA
    Hammeke, TA
    Rao, SM
    Cox, RW
    [J]. BRAIN, 1996, 119 : 1239 - 1247