Identifying and Quantifying Multisensory Integration: A Tutorial Review

被引:161
作者
Stevenson, Ryan A. [1 ,2 ,3 ,4 ]
Ghose, Dipanwita [5 ]
Fister, Juliane Krueger [3 ,6 ,7 ]
Sarko, Diana K. [2 ,8 ]
Altieri, Nicholas A. [9 ]
Nidiffer, Aaron R. [2 ]
Kurela, LeAnne R. [3 ,6 ,7 ]
Siemann, Justin K. [3 ,4 ,6 ,7 ,10 ]
James, Thomas W. [11 ]
Wallace, Mark T. [2 ,3 ,4 ,5 ,12 ]
机构
[1] Univ Toronto, Dept Psychol, Toronto, ON M5S 1A1, Canada
[2] Vanderbilt Univ, Med Ctr, Dept Hearing & Speech Sci, Nashville, TN USA
[3] Vanderbilt Brain Inst, Nashville, TN USA
[4] Vanderbilt Kennedy Ctr, Nashville, TN USA
[5] Vanderbilt Univ, Dept Psychol, Nashville, TN 37240 USA
[6] Vanderbilt Univ, Med Ctr, Neurosci Grad Program, Nashville, TN USA
[7] Vanderbilt Univ, Med Ctr, Clin Neurosci Scholars Program, Nashville, TN USA
[8] Edward Via Coll Osteopath Med, Dept Anat Cell Biol & Physiol, Spartanburg, SC USA
[9] Idaho State Univ, Dept Commun Sci & Disorders, Pocatello, ID 83209 USA
[10] Vanderbilt Univ, Med Ctr, Silvio O Conte Ctr Neurosci Res, Nashville, TN USA
[11] Indiana Univ, Dept Psychol & Brain Sci, Bloomington, IN USA
[12] Vanderbilt Univ, Dept Psychiat, Nashville, TN 37235 USA
基金
美国国家卫生研究院;
关键词
Audiovisual; fMRI; EEG; Response time; Accuracy; Sensory processing; SUPERIOR TEMPORAL SULCUS; TRANSCRANIAL MAGNETIC STIMULATION; AUDITORY CORTICAL-NEURONS; DECISION-RELATED ACTIVITY; LOCAL-FIELD POTENTIALS; ADDITIVE FACTOR METHOD; SOUND-LOCALIZATION; EVOKED-POTENTIALS; SINGLE NEURONS; REACTION-TIME;
D O I
10.1007/s10548-014-0365-7
中图分类号
R74 [神经病学与精神病学];
学科分类号
摘要
We process information from the world through multiple senses, and the brain must decide what information belongs together and what information should be segregated. One challenge in studying such multisensory integration is how to quantify the multisensory interactions, a challenge that is amplified by the host of methods that are now used to measure neural, behavioral, and perceptual responses. Many of the measures that have been developed to quantify multisensory integration (and which have been derived from single unit analyses), have been applied to these different measures without much consideration for the nature of the process being studied. Here, we provide a review focused on the means with which experimenters quantify multisensory processes and integration across a range of commonly used experimental methodologies. We emphasize the most commonly employed measures, including single- and multiunit responses, local field potentials, functional magnetic resonance imaging, and electroencephalography, along with behavioral measures of detection, accuracy, and response times. In each section, we will discuss the different metrics commonly used to quantify multisensory interactions, including the rationale for their use, their advantages, and the drawbacks and caveats associated with them. Also discussed are possible alternatives to the most commonly used metrics.
引用
收藏
页码:707 / 730
页数:24
相关论文
共 252 条
[1]   ENCODING OF SOUND-SOURCE LOCATION AND MOVEMENT - ACTIVITY OF SINGLE NEURONS AND INTERACTIONS BETWEEN ADJACENT NEURONS IN THE MONKEY AUDITORY-CORTEX [J].
AHISSAR, M ;
AHISSAR, E ;
BERGMAN, H ;
VAADIA, E .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 67 (01) :203-215
[2]   Multisensory processing in "unimodal" neurons: Cross-modal subthreshold auditory effects in cat extrastriate visual cortex [J].
Allman, Brian L. ;
Meredith, M. Alex .
JOURNAL OF NEUROPHYSIOLOGY, 2007, 98 (01) :545-549
[3]   Not Just for Bimodal Neurons Anymore: The Contribution of Unimodal Neurons to Cortical Multisensory Processing [J].
Allman, Brian L. ;
Keniston, Leslie P. ;
Meredith, M. Alex .
BRAIN TOPOGRAPHY, 2009, 21 (3-4) :157-167
[4]   Subthreshold auditory inputs to extrastriate visual neurons are responsive to parametric changes in stimulus quality: Sensory-specific versus non-specific coding [J].
Allman, Brian L. ;
Keniston, Leslie P. ;
Meredith, M. Alex .
BRAIN RESEARCH, 2008, 1242 :95-101
[5]   Learning to Associate Auditory and Visual Stimuli: Behavioral and Neural Mechanisms [J].
Altieri, Nicholas ;
Stevenson, Ryan A. ;
Wallace, Mark T. ;
Wenger, Michael J. .
BRAIN TOPOGRAPHY, 2015, 28 (03) :479-493
[6]   An assessment of behavioral dynamic information processing measures in audiovisual speech perception [J].
Altieri, Nicholas ;
Townsend, James T. .
FRONTIERS IN PSYCHOLOGY, 2011, 2
[7]   Selecting the signals for a brain-machine interface [J].
Andersen, RA ;
Musallam, S ;
Pesaran, B .
CURRENT OPINION IN NEUROBIOLOGY, 2004, 14 (06) :720-726
[8]   Factors influencing audiovisual fission and fusion illusions [J].
Andersen, TS ;
Tiippana, K ;
Sams, M .
COGNITIVE BRAIN RESEARCH, 2004, 21 (03) :301-308
[9]   Visual and vestibular cue integration for heading perception in extrastriate visual cortex [J].
Angelaki, Dora E. ;
Gu, Yong ;
DeAngelis, Gregory C. .
JOURNAL OF PHYSIOLOGY-LONDON, 2011, 589 (04) :825-833
[10]  
[Anonymous], 1959, INDIVIDUAL CHOICE BE