Identifying and Quantifying Multisensory Integration: A Tutorial Review

被引:161
作者
Stevenson, Ryan A. [1 ,2 ,3 ,4 ]
Ghose, Dipanwita [5 ]
Fister, Juliane Krueger [3 ,6 ,7 ]
Sarko, Diana K. [2 ,8 ]
Altieri, Nicholas A. [9 ]
Nidiffer, Aaron R. [2 ]
Kurela, LeAnne R. [3 ,6 ,7 ]
Siemann, Justin K. [3 ,4 ,6 ,7 ,10 ]
James, Thomas W. [11 ]
Wallace, Mark T. [2 ,3 ,4 ,5 ,12 ]
机构
[1] Univ Toronto, Dept Psychol, Toronto, ON M5S 1A1, Canada
[2] Vanderbilt Univ, Med Ctr, Dept Hearing & Speech Sci, Nashville, TN USA
[3] Vanderbilt Brain Inst, Nashville, TN USA
[4] Vanderbilt Kennedy Ctr, Nashville, TN USA
[5] Vanderbilt Univ, Dept Psychol, Nashville, TN 37240 USA
[6] Vanderbilt Univ, Med Ctr, Neurosci Grad Program, Nashville, TN USA
[7] Vanderbilt Univ, Med Ctr, Clin Neurosci Scholars Program, Nashville, TN USA
[8] Edward Via Coll Osteopath Med, Dept Anat Cell Biol & Physiol, Spartanburg, SC USA
[9] Idaho State Univ, Dept Commun Sci & Disorders, Pocatello, ID 83209 USA
[10] Vanderbilt Univ, Med Ctr, Silvio O Conte Ctr Neurosci Res, Nashville, TN USA
[11] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN USA
[12] Vanderbilt Univ, Dept Psychiat, Nashville, TN 37235 USA
基金
美国国家卫生研究院;
关键词
Audiovisual; fMRI; EEG; Response time; Accuracy; Sensory processing; SUPERIOR TEMPORAL SULCUS; TRANSCRANIAL MAGNETIC STIMULATION; AUDITORY CORTICAL-NEURONS; DECISION-RELATED ACTIVITY; LOCAL-FIELD POTENTIALS; ADDITIVE FACTOR METHOD; SOUND-LOCALIZATION; EVOKED-POTENTIALS; SINGLE NEURONS; REACTION-TIME;
D O I
10.1007/s10548-014-0365-7
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
We process information from the world through multiple senses, and the brain must decide what information belongs together and what information should be segregated. One challenge in studying such multisensory integration is how to quantify the multisensory interactions, a challenge that is amplified by the host of methods that are now used to measure neural, behavioral, and perceptual responses. Many of the measures that have been developed to quantify multisensory integration (and which have been derived from single unit analyses), have been applied to these different measures without much consideration for the nature of the process being studied. Here, we provide a review focused on the means with which experimenters quantify multisensory processes and integration across a range of commonly used experimental methodologies. We emphasize the most commonly employed measures, including single- and multiunit responses, local field potentials, functional magnetic resonance imaging, and electroencephalography, along with behavioral measures of detection, accuracy, and response times. In each section, we will discuss the different metrics commonly used to quantify multisensory interactions, including the rationale for their use, their advantages, and the drawbacks and caveats associated with them. Also discussed are possible alternatives to the most commonly used metrics.
引用
收藏
页码:707 / 730
页数:24
相关论文
共 252 条
[31]   Electrophysiological (EEG, sEEG, MEG) evidence for multiple audiovisual interactions in the human auditory cortex [J].
Besle, Julien ;
Bertrand, Olivier ;
Giard, Marie-Helene .
HEARING RESEARCH, 2009, 258 (1-2) :143-151
[32]   Visual Activation and Audiovisual Interactions in the Auditory Cortex during Speech Perception: Intracranial Recordings in Humans [J].
Besle, Julien ;
Fischer, Catherine ;
Bidet-Caulet, Aurelie ;
Lecaignard, Francoise ;
Bertrand, Olivier ;
Giard, Marie-Helene .
JOURNAL OF NEUROSCIENCE, 2008, 28 (52) :14301-14310
[33]   Visual-auditory spatial processing in auditory cortical neurons [J].
Bizley, Jennifer K. ;
King, Andrew J. .
BRAIN RESEARCH, 2008, 1242 :24-36
[34]   Multisensory processing after a brain damage: Clues on post-injury crossmodal plasticity from neuropsychology [J].
Bolognini, Nadia ;
Convento, Silvia ;
Rossetti, Angela ;
Merabet, Lotfi B. .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2013, 37 (03) :269-278
[35]  
Boyden Edward S, 2011, Cerebrum, V2011, P16
[36]   Linear systems analysis of functional magnetic resonance imaging in human V1 [J].
Boynton, GM ;
Engel, SA ;
Glover, GH ;
Heeger, DJ .
JOURNAL OF NEUROSCIENCE, 1996, 16 (13) :4207-4221
[37]   Encoding of three-dimensional structure-from-motion by primate area MT neurons [J].
Bradley, DC ;
Chang, GC ;
Andersen, RA .
NATURE, 1998, 392 (6677) :714-717
[38]  
Brecht M, 1999, J NEUROSCI, V19, P3567
[39]   A relationship between behavioral choice and the visual responses of neurons in macaque MT [J].
Britten, KH ;
Newsome, WT ;
Shadlen, MN ;
Celebrini, S ;
Movshon, JA .
VISUAL NEUROSCIENCE, 1996, 13 (01) :87-100
[40]  
BRITTEN KH, 1992, J NEUROSCI, V12, P4745