Integration of auditory and vibrotactile stimuli: Effects of phase and stimulus-onset asynchrony

被引:33
作者
Wilson, E. Courtenay [1 ]
Reed, Charlotte M.
Braida, Louis D.
机构
[1] MIT, Elect Res Lab, Cambridge, MA 02139 USA
关键词
SUPERIOR TEMPORAL PLANE; MULTISENSORY CONVERGENCE; ASSOCIATION CORTEX; TACTILE STIMULI; SIGNAL DELAY; MASKING; SOUND; PERCEPTION; INTENSITY; FREQUENCY;
D O I
10.1121/1.3204305
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
The perceptual integration of 250 Hz, 500 ms vibrotactile and auditory tones was studied in detection experiments as a function of (1) relative phase and (2) temporal asynchrony of the tone pulses. Vibrotactile stimuli were delivered through a single-channel vibrator to the left middle fingertip and auditory stimuli were presented diotically through headphones in a background of 50 dB sound pressure level broadband noise. The vibrotactile and auditory stimulus levels used each yielded 63%-77%-correct unimodal detection performance in a 2-1, 2-AFC task. Results for combined vibrotactile and auditory detection indicated that (1) performance improved for synchronous presentation, (2) performance was not affected by the relative phase of the auditory and tactile sinusoidal stimuli, and (3) performance for non-overlapping stimuli improved only if the tactile stimulus preceded the auditory. The results are generally more consistent with a "Pythagorean Sum" model than with either an "Algebraic Sum" or an "Optimal Single-Channel" Model of perceptual integration. Thus, certain combinations of auditory and tactile signals result in significant integrative effects. The lack of phase effect suggests an envelope rather than fine-structure operation for integration. The effects of asynchronous presentation of the auditory and tactile stimuli are consistent with time constants deduced from single-modality masking experiments. (C) 2009 Acou.stical Society of America. [DOI: 10.1121/1.3204305]
引用
收藏
页码:1960 / 1974
页数:15
相关论文
共 57 条
[1]  
[Anonymous], HDB MULTISENSORY PRO
[2]   Vibrotactile intensity and frequency information in the Pacinian system:: A psychophysical model [J].
Bensmaïa, S ;
Hollins, M ;
Yau, J .
PERCEPTION & PSYCHOPHYSICS, 2005, 67 (05) :828-841
[3]   Sound-induced illusory flash perception: role of gamma band responses [J].
Bhattacharya, J ;
Shams, L ;
Shimojo, S .
NEUROREPORT, 2002, 13 (14) :1727-1730
[4]   CROSSMODAL INTEGRATION IN THE IDENTIFICATION OF CONSONANT SEGMENTS [J].
BRAIDA, LD .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION A-HUMAN EXPERIMENTAL PSYCHOLOGY, 1991, 43 (03) :647-677
[5]   Feeling what you hear: auditory signals can modulate tactile tap perception [J].
Bresciani, JP ;
Ernst, MO ;
Drewing, K ;
Bouyer, G ;
Maury, V ;
Kheddar, A .
EXPERIMENTAL BRAIN RESEARCH, 2005, 162 (02) :172-180
[6]   Tactile "capture" of audition [J].
Caclin, A ;
Soto-Faraco, S ;
Kingstone, A ;
Spence, C .
PERCEPTION & PSYCHOPHYSICS, 2002, 64 (04) :616-630
[7]   Evidence of vibrotactile input to human auditory cortex [J].
Caetano, G ;
Jousmäki, V .
NEUROIMAGE, 2006, 29 (01) :15-28
[8]   Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey [J].
Cappe, C ;
Barone, P .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2005, 22 (11) :2886-2902
[9]   VIBROTACTILE MASKING AND THE PERSISTENCE OF TACTUAL FEATURES [J].
CRAIG, JC ;
EVANS, PM .
PERCEPTION & PSYCHOPHYSICS, 1987, 42 (04) :309-317
[10]   BONE CONDUCTION THRESHOLDS FOR NORMAL LISTENERS IN FORCE AND ACCELERATION UNITS [J].
DIRKS, DD ;
KAMM, C ;
GILMAN, S .
JOURNAL OF SPEECH AND HEARING RESEARCH, 1976, 19 (01) :181-186