Intersensory binding across space and time: A tutorial review

被引:52
作者
Chen, Lihan [1 ,2 ]
Vroomen, Jean [3 ]
机构
[1] Peking Univ, Dept Psychol, Beijing 100871, Peoples R China
[2] Peking Univ, Minist Educ, Key Lab Machine Percept, Beijing 100871, Peoples R China
[3] Tilburg Univ, Dept Psychol, NL-5000 LE Tilburg, Netherlands
关键词
Multisensory Processing; Temporal processing; Spatial localization; MODULATE AUDIOVISUAL INTEGRATION; AUDITORY-VISUAL INTERACTION; SUPERIOR TEMPORAL SULCUS; MISMATCH NEGATIVITY MMN; MULTISENSORY INTEGRATION; SOUND LOCALIZATION; SPATIAL ATTENTION; APPARENT MOTION; TACTILE CAPTURE; CROSSMODAL INTERACTION;
D O I
10.3758/s13414-013-0475-4
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Spatial ventriloquism refers to the phenomenon that a visual stimulus such as a flash can attract the perceived location of a spatially discordant but temporally synchronous sound. An analogous example of mutual attraction between audition and vision has been found in the temporal domain, where temporal aspects of a visual event, such as its onset, frequency, or duration, can be biased by a slightly asynchronous sound. In this review, we examine various-manifestations of spatial and temporal attraction between the senses (both direct effects and aftereffects), and we discuss important constraints on the occurrence of these effects. Factors that potentially modulate ventriloquism-such as attention, synesthetic correspondence, and other cognitive factors-are described. We trace theories and models of spatial and temporal ventriloquism, from the traditional unity assumption and modality appropriateness hypothesis to more recent Bayesian and neural network approaches. Finally, we summarize recent evidence probing the underlying neural mechanisms of spatial and temporal ventriloquism.
引用
收藏
页码:790 / 811
页数:22
相关论文
共 229 条
[1]   The ventriloquist effect results from near-optimal bimodal integration [J].
Alais, D ;
Burr, D .
CURRENT BIOLOGY, 2004, 14 (03) :257-262
[2]   No direction-specific bimodal facilitation for audiovisual motion detection [J].
Alais, D ;
Burr, D .
COGNITIVE BRAIN RESEARCH, 2004, 19 (02) :185-194
[3]  
[Anonymous], 2002, Computational Neuroscience of Vision
[4]  
[Anonymous], P 33 ANN C COGN SCI
[5]   Perceptual synchrony of audiovisual streams for natural and artificial motion sequences [J].
Arrighi, Roberto ;
Alais, David ;
Burr, David .
JOURNAL OF VISION, 2006, 6 (03) :260-268
[6]   Temporal ventriloquism: crossmodal interaction on the time dimension - 2. Evidence from sensorimotor synchronization [J].
Aschersleben, G ;
Bertelson, P .
INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2003, 50 (1-2) :157-163
[7]   Bayesian integration of visual and auditory signals for spatial localization [J].
Battaglia, PW ;
Jacobs, RA ;
Aslin, RN .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2003, 20 (07) :1391-1397
[8]   CONSTRAINTS ON LEARNING NEW MAPPINGS BETWEEN PERCEPTUAL DIMENSIONS [J].
BEDFORD, FL .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-HUMAN PERCEPTION AND PERFORMANCE, 1989, 15 (02) :232-248
[9]   Crossmodal integration in the primate superior colliculus underlying the preparation and initiation of saccadic eye movements [J].
Bell, AH ;
Meredith, MA ;
Van Opstal, AJ ;
Munoz, DP .
JOURNAL OF NEUROPHYSIOLOGY, 2005, 93 (06) :3659-3673
[10]   AUDITORY-VISUAL INTERACTION IN SINGLE CELLS IN CORTEX OF SUPERIOR TEMPORAL SULCUS AND ORBITAL FRONTAL CORTEX OF MACAQUE MONKEY [J].
BENEVENTO, LA ;
FALLON, J ;
DAVIS, BJ ;
REZAK, M .
EXPERIMENTAL NEUROLOGY, 1977, 57 (03) :849-872