The Effect of Temporal Alignment on Audiovisual Integration in a Divided Attention Task

被引:0
作者
Yang, Jingjing [1 ]
Li, Xiujun [1 ]
Li, Qi [1 ]
Zhao, Xiaojun [1 ]
Wu, Jinglong [2 ]
Li, Lingjun [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, Changchun, Jilin, Peoples R China
[2] Okayama Univ, Grad Sch Nat Sci & Technol, Biomed Engn Lab, Okayama 7008530, Japan
来源
2015 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION | 2015年
关键词
Audiovisual interaction; spatial information; event-related potential; MULTISENSORY INTEGRATION; VISUAL-STIMULI; ENHANCEMENT; PERCEPTION; SOUND;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human brains can integrate various kinds of information from different modalities to perceive the complex environment. When an event produces sound and light, we usually do not notice any temporal disparities between the two sensory inputs even though the sound arrives before or after the light. The aim of this study is to investigate the effect of asynchrony audiovisual stimuli on audiovisual integration. In present study, visual and auditory stimuli onset asynchrony (SOA = +/- 250 ms, +/- 200 ms, +/- 150 ms, +/- 100 ms, +/- 50 ms, 0 ms), both the auditory and visual stimuli were attended. From the results, reaction times to AV target stimuli (excepted -250ms condition) were significantly shorter than that to unimodal auditory condition; The Reaction times to SOA = -100ms, -50ms, 0, 50ms were significantly shorter than that to unimodal visual condition. The result of cumulative distribution functions (CDFs) shown that the significant audiovisual integration were found at SOA = -100ms, -50ms, 0, 50ms conditions. These results revealed the multimodal audiovisual stimuli enhanced the detection and the audiovisual integration was elicited by temporal approach of audiovisual stimuli.
引用
收藏
页码:865 / 870
页数:6
相关论文
共 19 条
[1]   The ventriloquist effect results from near-optimal bimodal integration [J].
Alais, D ;
Burr, D .
CURRENT BIOLOGY, 2004, 14 (03) :257-262
[2]   Attention alters appearance [J].
Carrasco, M ;
Ling, S ;
Read, S .
NATURE NEUROSCIENCE, 2004, 7 (03) :308-313
[3]   Visual-tactile spatial interaction in saccade generation [J].
Diederich, A ;
Colonius, H ;
Bockhorst, D ;
Tabeling, S .
EXPERIMENTAL BRAIN RESEARCH, 2003, 148 (03) :328-337
[4]   Enhancement of visual perception by crossmodal visuo-auditory interaction [J].
Frassinetti, F ;
Bolognini, N ;
Làdavas, E .
EXPERIMENTAL BRAIN RESEARCH, 2002, 147 (03) :332-343
[5]   SPATIAL AND TEMPORAL FACTORS DETERMINE AUDITORY-VISUAL INTERACTIONS IN HUMAN SACCADIC EYE-MOVEMENTS [J].
FRENS, MA ;
VANOPSTAL, AJ ;
VANDERWILLIGEN, RF .
PERCEPTION & PSYCHOPHYSICS, 1995, 57 (06) :802-816
[6]   Auditory enhancement of visual temporal order judgment [J].
Hairston, W. David ;
Hodges, Donald A. ;
Burdette, Jonathan H. ;
Wallace, Mark T. .
NEUROREPORT, 2006, 17 (08) :791-795
[7]   Visual localization ability influences cross-modal bias [J].
Hairston, WD ;
Wallace, MT ;
Vaughan, JW ;
Stein, BE ;
Norris, JL ;
Schirillo, JA .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2003, 15 (01) :20-29
[8]   Auditory-visual temporal integration as a function of distance: no compensation for sound-transmission time in human perception [J].
Lewald, J ;
Guski, R .
NEUROSCIENCE LETTERS, 2004, 357 (02) :119-122
[9]   Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli [J].
Lewald, J ;
Guski, R .
COGNITIVE BRAIN RESEARCH, 2003, 16 (03) :468-478
[10]   Audiovisual interaction enhances auditory detection in late stage: an event-related potential study [J].
Li, Qi ;
Wu, Jinglong ;
Touge, Tetsuo .
NEUROREPORT, 2010, 21 (03) :173-178