The Effect of Visual Stimuli on Auditory Detection in a Auditory Attention Task

被引:0
作者
Yang, Jingjing [1 ]
Li, Xiujun [1 ]
Li, Qi [1 ]
Xiao, Xinwei [1 ]
Wu, Qiong [2 ]
Wu, Jinglong [2 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, 7089 Weixing Rd, Changchun, Jilin, Peoples R China
[2] Okayama Univ, Grad Sch Nat Sci & Technol, Kita Ku, Tsushima Naka 3-1-1, Okayama 7008530, Japan
来源
2017 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION (ICMA) | 2017年
关键词
Audiovisual interaction; spatial information; event-related potential; MULTISENSORY INTEGRATION; SELECTIVE ATTENTION; HUMANS; SOUND; VENTRILOQUISM; LOCALIZATION; ENHANCEMENT;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Converging evidence indicates that spatial information of stimuli plays an important role in multisensory interaction. The spatial characteristics of auditory stimuli tended to be biased toward the spatial characteristics of visual stimuli. Many studies have shown that spatial consistency of audiovisual stimuli can influence the interaction between visual and auditory stimulus, however, the multisensory mechanisms were not well understood. Here, we investigated the effect of visual spatial information on auditory detection in a auditory attention task. The auditory stimuli were presented through two speakers that was placed on the left and right of the display. The visual stimuli were presented on the left (-8 degrees), right (+8 degrees) or central (0 degrees) locations. Visual stimuli and auditory stimuli were presented in a consistent or inconsistent position. From the results, the responses to consistent audiovisual stimuli were faster and more accurate than inconsistent stimuli. The effect of the left and right stimuli were greater in the central visual flash. This study provided evidence that auditory detection can be affected by the visual stimuli come from different spatial locations even if the visual stimuli were not attended. We expect that these results could helpful to process the audiovisual information of artificial intelligence.
引用
收藏
页码:1567 / 1572
页数:6
相关论文
共 27 条
  • [1] The ventriloquist effect results from near-optimal bimodal integration
    Alais, D
    Burr, D
    [J]. CURRENT BIOLOGY, 2004, 14 (03) : 257 - 262
  • [2] Attention alters appearance
    Carrasco, M
    Ling, S
    Read, S
    [J]. NATURE NEUROSCIENCE, 2004, 7 (03) : 308 - 313
  • [3] Visual-tactile spatial interaction in saccade generation
    Diederich, A
    Colonius, H
    Bockhorst, D
    Tabeling, S
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2003, 148 (03) : 328 - 337
  • [5] Enhancement of visual perception by crossmodal visuo-auditory interaction
    Frassinetti, F
    Bolognini, N
    Làdavas, E
    [J]. EXPERIMENTAL BRAIN RESEARCH, 2002, 147 (03) : 332 - 343
  • [6] SPATIAL AND TEMPORAL FACTORS DETERMINE AUDITORY-VISUAL INTERACTIONS IN HUMAN SACCADIC EYE-MOVEMENTS
    FRENS, MA
    VANOPSTAL, AJ
    VANDERWILLIGEN, RF
    [J]. PERCEPTION & PSYCHOPHYSICS, 1995, 57 (06): : 802 - 816
  • [7] Auditory enhancement of visual temporal order judgment
    Hairston, W. David
    Hodges, Donald A.
    Burdette, Jonathan H.
    Wallace, Mark T.
    [J]. NEUROREPORT, 2006, 17 (08) : 791 - 795
  • [8] Visual localization ability influences cross-modal bias
    Hairston, WD
    Wallace, MT
    Vaughan, JW
    Stein, BE
    Norris, JL
    Schirillo, JA
    [J]. JOURNAL OF COGNITIVE NEUROSCIENCE, 2003, 15 (01) : 20 - 29
  • [9] Horizontal and vertical effects of eye-position on sound localization
    Lewald, J
    Getzmann, S
    [J]. HEARING RESEARCH, 2006, 213 (1-2) : 99 - 106
  • [10] Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli
    Lewald, J
    Guski, R
    [J]. COGNITIVE BRAIN RESEARCH, 2003, 16 (03): : 468 - 478