Temporal mechanisms of multimodal binding

被引:47
作者
Burr, David [1 ,2 ]
Silva, Ottavia [3 ]
Cicchini, Guido Marco [3 ]
Banks, Martin S. [4 ]
Morrone, Maria Concetta [5 ,6 ]
机构
[1] Univ Florence, Dept Psychol, I-50125 Florence, Italy
[2] Univ Western Australia, Sch Psychol, Nedlands, WA 6009, Australia
[3] Univ Vita Salute San Raffaele, Fac Psychol, I-20132 Milan, Italy
[4] Univ Calif Berkeley, Dept Psychol, Sch Optometry, Vis Sci Program, Berkeley, CA 94720 USA
[5] Univ Pisa, Dept Physiol Sci, I-56100 Pisa, Italy
[6] Sci Inst Stella Maris, I-56018 Pisa, Italy
关键词
time perception; vision; audition; binding; cross-modal; HUMAN-VISION; CONTRAST DISCRIMINATION; CATEGORICAL PERCEPTION; AUDITORY FLUTTER; VISUAL FLICKER; TIME; LUMINANCE; SYNCHRONY; INTERVAL; MASKING;
D O I
10.1098/rspb.2008.1899
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The simultaneity of signals from different senses - such as vision and audition - is a useful cue for determining whether those signals arose from one environmental source or from more than one. To understand better the sensory mechanisms for assessing simultaneity, we measured the discrimination thresholds for time intervals marked by auditory, visual or auditory - visual stimuli, as a function of the base interval. For all conditions, both unimodal and cross-modal, the thresholds followed a characteristic 'dipper function' in which the lowest thresholds occurred when discriminating against a non-zero interval. The base interval yielding the lowest threshold was roughly equal to the threshold for discriminating asynchronous from synchronous presentations. Those lowest thresholds occurred at approximately 5, 15 and 75 ms for auditory, visual and auditory - visual stimuli, respectively. Thus, the mechanisms mediating performance with cross-modal stimuli are considerably slower than the mechanisms mediating performance within a particular sense. We developed a simple model with temporal filters of different time constants and showed that the model produces discrimination functions similar to the ones we observed in humans. Both for processing within a single sense, and for processing across senses, temporal perception is affected by the properties of temporal filters, the outputs of which are used to estimate time offsets, correlations between signals, and more.
引用
收藏
页码:1761 / 1769
页数:9
相关论文
共 59 条
[11]  
BURR D, J VIS IN PRESS, V9
[12]   TEMPORAL SUMMATION OF MOVING IMAGES BY THE HUMAN VISUAL-SYSTEM [J].
BURR, DC .
PROCEEDINGS OF THE ROYAL SOCIETY SERIES B-BIOLOGICAL SCIENCES, 1981, 211 (1184) :321-339
[13]   Motion deblurring in human vision [J].
Burr, DC ;
Morgan, MJ .
PROCEEDINGS OF THE ROYAL SOCIETY B-BIOLOGICAL SCIENCES, 1997, 264 (1380) :431-436
[14]   Motion analysis by feature tracking [J].
Del Viva, MM ;
Morrone, MC .
VISION RESEARCH, 1998, 38 (22) :3633-3653
[16]   Humans integrate visual and haptic information in a statistically optimal fashion [J].
Ernst, MO ;
Banks, MS .
NATURE, 2002, 415 (6870) :429-433
[17]   The temporal cross-capture of audition and vision [J].
Fendrich, R ;
Corballis, PM .
PERCEPTION & PSYCHOPHYSICS, 2001, 63 (04) :719-725
[18]   HUMAN LUMINANCE PATTERN-VISION MECHANISMS - MASKING EXPERIMENTS REQUIRE A NEW MODEL [J].
FOLEY, JM .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1994, 11 (06) :1710-1719
[19]   PERCEPTION AND ESTIMATION OF TIME [J].
FRAISSE, P .
ANNUAL REVIEW OF PSYCHOLOGY, 1984, 35 :1-36
[20]   Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals [J].
Fujisaki, W ;
Nishida, S .
EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :455-464