Audiovisual multisensory integration

被引:150
作者
Spence, Charles [1 ]
机构
[1] Univ Oxford, Dept Expt Psychol, Crossmodal Res Lab, South Parks Rd, Oxford OX1 3UD, England
关键词
Multisensory integration; Crossmodal; Audiovisual; Binding; Perception;
D O I
10.1250/ast.28.61
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Over the last 50 years or so, a large body of empirical research has demonstrated the importance of a variety of low-level spatiotemporal factors in the multisensory integration of auditory and visual stimuli (as, for example, indexed by research on the ventriloquism effect). Here, the evidence highlighting the contribution of both spatial and temporal factors to multisensory integration is briefly reviewed. The role played by the temporal correlation between auditory and visual signals, stimulus motion, intramodal versus crossmodal perceptual grouping, semantic congruency, and the unity assumption in modulating multisensory integration is also discussed. Taken together, the evidence now supports the view that a number of different factors, both structural and cognitive, conjointly contribute to the multisensory integration (or binding) of auditory and visual information.
引用
收藏
页码:61 / 70
页数:10
相关论文
共 58 条
[1]   The ventriloquist effect results from near-optimal bimodal integration [J].
Alais, D ;
Burr, D .
CURRENT BIOLOGY, 2004, 14 (03) :257-262
[2]   Timing sight and sound [J].
Arnold, DH ;
Johnston, A ;
Nishida, S .
VISION RESEARCH, 2005, 45 (10) :1275-1284
[3]   Bayesian integration of visual and auditory signals for spatial localization [J].
Battaglia, PW ;
Jacobs, RA ;
Aslin, RN .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2003, 20 (07) :1391-1397
[4]  
Bedford FL, 2001, CAH PSYCHOL COGN, V20, P113
[5]  
Bergmann D., 2006, 7 IMRF M 18 21 JUN T
[6]   EFFECT OF DEGREE OF SEPARATION OF VISUAL-AUDITORY STIMULUS AND EYE POSITION UPON SPATIAL INTERACTION OF VISION AND AUDITION [J].
BERMANT, RI ;
WELCH, RB .
PERCEPTUAL AND MOTOR SKILLS, 1976, 43 (02) :487-493
[7]  
Bertelson P., 2004, CROSSMODAL SPACE CRO, P141, DOI DOI 10.1093/ACPROF:OSO/9780198524861.003.0007
[8]   Neural correlates of cross-modal binding [J].
Bushara, KO ;
Hanakawa, T ;
Immisch, I ;
Toma, K ;
Kansaku, K ;
Hallett, M .
NATURE NEUROSCIENCE, 2003, 6 (02) :190-195
[9]   HUMAN SENSORY DOMINANCE [J].
COLAVITA, FB .
PERCEPTION & PSYCHOPHYSICS, 1974, 16 (02) :409-412
[10]   Multisensory integration, perception and ecological validity [J].
De Gelder, B ;
Bertelson, P .
TRENDS IN COGNITIVE SCIENCES, 2003, 7 (10) :460-467