Spatial variations of visual-auditory fusion areas

被引:27
|
作者
Godfroy, M [1 ]
Roumes, C [1 ]
Dauchy, P [1 ]
机构
[1] IMASSA, Dept Cognit Sci, F-91223 Bretigny sur Orge, France
关键词
D O I
10.1068/p3344
中图分类号
R77 [眼科学];
学科分类号
100212 ;
摘要
The tolerance to spatial disparity between two synchronous visual and auditory components of a bimodal stimulus has been investigated in order to assess their respective contributions to perceptual fusion. The visual and auditory systems each have specific information-processing mechanisms, and provide different cues for scene perception, with the respective dominance of space for vision and of time for hearing. A broadband noise burst and a spot of light, 500 ms in duration, have been simultaneously presented to participants who had to judge whether these cues referred to a single spatial event. We examined the influence of (i) the range and the direction of spatial disparity between the visual and auditory components of a stimulation and (ii) the eccentricity of the bimodal stimulus in the observer's perceptual field. Size and shape properties of visual-auditory fusion areas have been determined in two dimensions. The greater the eccentricity within the perceptual field, the greater the dimension of these areas; however, this increase in size also depends on whether the direction of the disparity is vertical or horizontal. Furthermore, the relative location of visual and auditory signals significantly modifies the perception of unity in the vertical plane. The shape of the fusion areas, their variation in the field, and the perceptual result associated with the relative location of the visual and auditory components of the stimulus, concur towards a strong contribution of audition to visual-auditory fusion. The spatial ambiguity of the localisation capabilities of the auditory system may play a more essential role than accurate visual resolution in determining fusion.
引用
收藏
页码:1233 / 1245
页数:13
相关论文
共 50 条
  • [21] Multi-Sensory Visual-Auditory Fusion of Wearable Navigation Assistance for People With Impaired Vision
    Song, Yang
    Li, Zhijun
    Li, Guoxin
    Wang, Binglu
    Zhu, Min
    Shi, Peng
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2023, : 1 - 13
  • [22] Influence of attention on visual and auditory masking effect in condition of visual-auditory dual tasks
    Pan, Yang
    Meng, Zihou
    Pan, Y., 1600, Science Press (38): : 215 - 223
  • [23] Exploring Visual-Auditory Redirected Walking Using Auditory Cues in Reality
    Ogawa, Kumpei
    Fujita, Kazuyuki
    Sakamoto, Shuichi
    Takashima, Kazuki
    Kitamura, Yoshifumi
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (08) : 5782 - 5794
  • [24] Multiple kernel visual-auditory representation learning for retrieval
    Hong Zhang
    Wenping Zhang
    Wenhe Liu
    Xin Xu
    Hehe Fan
    Multimedia Tools and Applications, 2016, 75 : 9169 - 9184
  • [25] Visual-auditory integration during speech imitation in autism
    Williams, JHG
    Massaro, DW
    Peel, NJ
    Bosseler, A
    Suddendorf, T
    RESEARCH IN DEVELOPMENTAL DISABILITIES, 2004, 25 (06) : 559 - 575
  • [26] Multiple kernel visual-auditory representation learning for retrieval
    Zhang, Hong
    Zhang, Wenping
    Liu, Wenhe
    Xu, Xin
    Fan, Hehe
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (15) : 9169 - 9184
  • [27] Effects of Visual-Auditory Incongruity on Product Expression and Surprise
    Ludden, Geke D. S.
    Schifferstein, Hendrik N. J.
    INTERNATIONAL JOURNAL OF DESIGN, 2007, 1 (03): : 29 - 39
  • [28] Multisensory enhancement of localization with synergetic visual-auditory cues
    Godfroy, Martine
    Roumes, Corinne
    PROCEEDINGS OF THE TWENTY-SIXTH ANNUAL CONFERENCE OF THE COGNITIVE SCIENCE SOCIETY, 2004, : 470 - 475
  • [29] ACQUISITION OF VISUAL-AUDITORY ASSOCIATIONS BY GOOD AND EXCELLENT READERS
    BARTHOLOMEUS, BN
    DOEHRING, DG
    PERCEPTUAL AND MOTOR SKILLS, 1972, 35 (03) : 847 - 855
  • [30] DISCREPANCY AND NONDISCREPANCY METHODS OF ASSESSING VISUAL-AUDITORY INTERACTION
    WARREN, DH
    MCCARTHY, TJ
    WELCH, RB
    PERCEPTION & PSYCHOPHYSICS, 1983, 33 (05): : 413 - 419