Auditory-visual temporal integration measured by shifts in perceived temporal location

被引:17
作者
Jaekl, Philip M. [1 ]
Harris, Laurence R. [1 ]
机构
[1] York Univ, Dept Psychol, Ctr Vis Res, Toronto, ON M3J 1P3, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
temporal ventriloquism; differential sensory latencies; multisensory processing; crossmodal processing; temporal location; perceived timing; multisensory temporal integration;
D O I
10.1016/j.neulet.2007.02.029
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The perceived time of occurrence of a visual stimulus may be shifted towards the onset of an auditory stimulus occurring a short time later. The effect has been attributed to auditory-visual temporal integration although an unknown portion of the shift may be explained by the different processing times of visual and auditory stimuli. Here, perceived onset time is measured in a novel way that separates and compares the magnitude of these effects. Participants observed either a sequence consisting of a visual stimulus followed by an auditory stimulus and then another visual stimulus or the reverse. The temporal location of the second stimulus was varied systematically between the onset of the first and third stimuli, which were separated by a fixed duration. Two timescales were used: a short timescale that allowed for auditory-visual temporal integration to occur, and a long timescale that did not. Psychometric curves were fitted for both timescales, to the percentage the first interval was perceived is shortest, as a function of first interval duration. For the long timescale condition the point of subjective equality (PSE) of the two interval lengths was consistent with the different processing latencies. When visual and auditory stimuli occurred within 125 ms significant additional shifting of the PSE occurred. These results indicate that temporal integration shifts the perceived timing of a visual stimulus by an amount much larger than can be explained differential processing latencies. (c) 2007 Elsevier Ireland Ltd. All rights reserved.
引用
收藏
页码:219 / 224
页数:6
相关论文
共 33 条
[1]   The ventriloquist effect results from near-optimal bimodal integration [J].
Alais, D ;
Burr, D .
CURRENT BIOLOGY, 2004, 14 (03) :257-262
[2]  
[Anonymous], 2008, LECT ELEMENTARY PSYC
[3]   Temporal ventriloquism: crossmodal interaction on the time dimension - 1. Evidence from auditory-visual temporal order judgment [J].
Bertelson, P ;
Aschersleben, G .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2003, 50 (1-2) :147-155
[4]   The psychophysics toolbox [J].
Brainard, DH .
SPATIAL VISION, 1997, 10 (04) :433-436
[5]   ORGANIZATION OF AUDITORY CORTICAL AREAS IN MAN [J].
CELESIA, GG .
BRAIN, 1976, 99 (SEP) :403-414
[6]   Multisensory integration, perception and ecological validity [J].
De Gelder, B ;
Bertelson, P .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (10) :460-467
[7]   Humans integrate visual and haptic information in a statistically optimal fashion [J].
Ernst, MO ;
Banks, MS .
NATURE, 2002, 415 (6870) :429-433
[8]   The temporal cross-capture of audition and vision [J].
Fendrich, R ;
Corballis, PM .
PERCEPTION & PSYCHOPHYSICS, 2001, 63 (04) :719-725
[9]   The case for feedforward multisensory convergence during early cortical processing [J].
Foxe, JJ ;
Schroeder, CE .
NEUROREPORT, 2005, 16 (05) :419-423
[10]   Visual localization ability influences cross-modal bias [J].
Hairston, WD ;
Wallace, MT ;
Vaughan, JW ;
Stein, BE ;
Norris, JL ;
Schirillo, JA .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2003, 15 (01) :20-29