Multisensory Integration: Flexible Use of General Operations

被引:203
作者
van Atteveldt, Nienke [1 ,2 ,3 ,4 ]
Murray, Micah M. [5 ,6 ,7 ,8 ]
Thut, Gregor [9 ]
Schroeder, Charles E. [10 ,11 ,12 ]
机构
[1] Royal Netherlands Acad Arts & Sci, Netherlands Inst Neurosci, Neuroimaging & Neuromodeling Grp, NL-1105 BA Amsterdam, Netherlands
[2] Vrije Univ Amsterdam, Fac Psychol & Educ, Dept Educ Neurosci, NL-1081 BT Amsterdam, Netherlands
[3] Vrije Univ Amsterdam, Inst LEARN, NL-1081 BT Amsterdam, Netherlands
[4] Maastricht Univ, Fac Psychol & Neurosci, Dept Cognit Neurosci, NL-6200 MD Maastricht, Netherlands
[5] Univ Hosp Ctr, Neuropsychol & Neurorehabil Serv, Lab Invest Neurophysiol LINE, CH-1011 Lausanne, Switzerland
[6] Univ Hosp Ctr, Radiodiagnost Serv, Lab Invest Neurophysiol LINE, CH-1011 Lausanne, Switzerland
[7] Univ Lausanne, CH-1011 Lausanne, Switzerland
[8] Ctr Biomed Imaging CIBM, EEG Brain Mapping Core, CH-1011 Lausanne, Switzerland
[9] Univ Glasgow, Inst Neurosci & Psychol, Glasgow G12 8QB, Lanark, Scotland
[10] Columbia Univ, Dept Psychiat, New York, NY 10032 USA
[11] New York State Psychiat Inst & Hosp, New York, NY 10032 USA
[12] Nathan S Kline Inst, Cognit Neurosci & Schizophrenia Program, Orangeburg, NY 10962 USA
基金
瑞士国家科学基金会; 美国国家卫生研究院; 英国惠康基金;
关键词
AUDITORY-VISUAL INTERACTIONS; NEURONAL OSCILLATIONS; UNISENSORY INTEGRATION; TEMPORAL INTEGRATION; SENSORY SUBSTITUTION; NORMALIZATION MODEL; SPEECH SOUNDS; CORTEX; BRAIN; TASK;
D O I
10.1016/j.neuron.2014.02.044
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Research into the anatomical substrates and "principles'' for integrating inputs from separate sensory surfaces has yielded divergent findings. This suggests that multisensory integration is flexible and context dependent and underlines the need for dynamically adaptive neuronal integration mechanisms. We propose that flexible multisensory integration can be explained by a combination of canonical, population-level integrative operations, such as oscillatory phase resetting and divisive normalization. These canonical operations subsume multisensory integration into a fundamental set of principles as to how the brain integrates all sorts of information, and they are being used proactively and adaptively. We illustrate this proposition by unifying recent findings from different research themes such as timing, behavioral goal, and experience-related differences in integration.
引用
收藏
页码:1240 / 1253
页数:14
相关论文
共 133 条
  • [1] Learning to Associate Auditory and Visual Stimuli: Behavioral and Neural Mechanisms
    Altieri, Nicholas
    Stevenson, Ryan A.
    Wallace, Mark T.
    Wenger, Michael J.
    [J]. BRAIN TOPOGRAPHY, 2015, 28 (03) : 479 - 493
  • [2] Multisensory versus unisensory integration: Contrasting modes in the superior colliculus
    Alvarado, Juan Carlos
    Vaughan, J. William
    Stanford, Terrence R.
    Stein, Barry E.
    [J]. JOURNAL OF NEUROPHYSIOLOGY, 2007, 97 (05) : 3193 - 3205
  • [3] A neural network model of multisensory integration also accounts for unisensory integration in superior colliculus
    Alvarado, Juan Carlos
    Rowland, Benjamin A.
    Stanford, Terrence R.
    Stein, Barry E.
    [J]. BRAIN RESEARCH, 2008, 1242 : 13 - 23
  • [4] Temporal recalibration of vision
    Arnold, Derek H.
    Yarrow, Kielan
    [J]. PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 2011, 278 (1705) : 535 - 538
  • [5] Sensory substitution and the human-machine interface
    Bach-y-Rita, P
    Kercel, SW
    [J]. TRENDS IN COGNITIVE SCIENCES, 2003, 7 (12) : 541 - 546
  • [6] Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions
    Barraclough, NE
    Xiao, DK
    Baker, CI
    Oram, MW
    Perrett, DI
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2005, 17 (03) : 377 - 391
  • [7] See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex
    Beauchamp, MS
    [J]. CURRENT OPINION IN NEUROBIOLOGY, 2005, 15 (02) : 145 - 153
  • [8] Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex
    Besle, Julien
    Bertrand, Olivier
    Giard, Marie-Helene
    [J]. HEARING RESEARCH, 2009, 258 (1-2) : 143 - 151
  • [9] Task-irrelevant visual letters interact with the processing of speech sounds in heteromodal and unimodal cortex
    Blau, Vera
    van Atteveldt, Nienke
    Formisano, Elia
    Goebel, Rainer
    Blomert, Leo
    [J]. EUROPEAN JOURNAL OF NEUROSCIENCE, 2008, 28 (03) : 500 - 509
  • [10] Reduced Neural Integration of Letters and Speech Sounds Links Phonological and Reading Deficits in Adult Dyslexia
    Blau, Vera
    van Atteveldt, Nienke
    Ekkebus, Michel
    Goebel, Rainer
    Blomert, Leo
    [J]. CURRENT BIOLOGY, 2009, 19 (06) : 503 - 508