Visual search for a target changing in synchrony with an auditory signal

被引:56
作者
Fujisaki, W
Koene, A
Arnold, D
Johnston, A
Nishida, S [1 ]
机构
[1] Nippon Telegraph & Tel Corp, Commun Sci Labs, Atsugi, Kanagawa 2430198, Japan
[2] UCL, Dept Psychol, London WC1E 6BT, England
关键词
cross modal perception; visual search; audio-visual synchrony;
D O I
10.1098/rspb.2005.3327
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
We examined whether the detection of audio-visual temporal synchrony is determined by a pre-attentive parallel process, or by an attentive serial process using a visual search paradigm. We found that detection of a visual target that changed in synchrony with an auditory stimulus was gradually impaired as the number of unsynchronized visual distractors increased (experiment 1), whereas synchrony discrimination of an attended target in a pre-cued location was unaffected by the presence of distractors (experiment 2). The effect of distractors cannot be ascribed to reduced target visibility nor can the increase in false alarm rates be predicted by a noisy parallel processing model. Reaction times for target detection increased linearly with number of distractors, with the slope being about twice as steep for target-absent trials as for target-present trials (experiment 3). Similar results were obtained regardless of whether the audio-visual stimulus consisted of visual flashes synchronized with amplitude-modulated pips, or of visual rotations synchronized with frequency-modulated up-down sweeps. All of the results indicate that audio-visual perceptual synchrony is judged by a serial process and are consistent with the suggestion that audio-visual temporal synchrony is detected by a 'mid-level' feature matching process.
引用
收藏
页码:865 / 874
页数:10
相关论文
共 50 条
[1]   Synchronizing to real events: Subjective audiovisual alignment scales with perceived auditory depth and speed of sound [J].
Alais, D ;
Carlile, S .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (06) :2244-2247
[2]   No direction-specific bimodal facilitation for audiovisual motion detection [J].
Alais, D ;
Burr, D .
COGNITIVE BRAIN RESEARCH, 2004, 19 (02) :185-194
[3]   Audiovisual integration of speech falters under high attention demands [J].
Alsius, A ;
Navarra, J ;
Campbell, R ;
Soto-Faraco, S .
CURRENT BIOLOGY, 2005, 15 (09) :839-843
[4]   Timing sight and sound [J].
Arnold, DH ;
Johnston, A ;
Nishida, S .
VISION RESEARCH, 2005, 45 (10) :1275-1284
[5]   Perceived timing of first- and second-order changes in vision and hearing [J].
Arrighi, R ;
Alais, D ;
Burr, D .
EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :445-454
[6]   The ventriloquist effect does not depend on the direction of deliberate visual attention [J].
Bertelson, P ;
Vroomen, J ;
de Gelder, B ;
Driver, J .
PERCEPTION & PSYCHOPHYSICS, 2000, 62 (02) :321-332
[7]   THE DETECTION OF AUDITORY VISUAL DESYNCHRONY [J].
DIXON, NF ;
SPITZ, L .
PERCEPTION, 1980, 9 (06) :719-721
[8]   Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading [J].
Driver, J .
NATURE, 1996, 381 (6577) :66-68
[9]   VISUAL-AUDITORY DISTANCE CONSTANCY [J].
ENGEL, GR ;
DOUGHERTY, WG .
NATURE, 1971, 234 (5327) :308-+
[10]   Temporal frequency characteristics of synchrony-asynchrony discrimination of audio-visual signals [J].
Fujisaki, W ;
Nishida, S .
EXPERIMENTAL BRAIN RESEARCH, 2005, 166 (3-4) :455-464