Perceptual thresholds of audio-visual spatial coherence for a variety of audio-visual objects

被引:0
|
作者
Stenzel, Hanne [1 ]
Jackson, Philip J. B. [1 ]
机构
[1] Univ Surrey, Ctr Vis Speech & Signal Proc, Guildford GU2 7XH, Surrey, England
来源
2018 AES INTERNATIONAL CONFERENCE ON AUDIO FOR VIRTUAL AND AUGMENTED REALITY | 2018年
基金
英国工程与自然科学研究理事会;
关键词
AUDIBLE MOVEMENT ANGLE; SOUND LOCALIZATION; FREQUENCY; NOISE;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Audio-visual spatial perception relies on the integration of both auditory and visual spatial information. Depending on auditory and visual features of the stimulus, and the relevance of each sound to the listener, offsets between both signals are more or less acceptable. The current paper investigates to which extent each of these factors influences how critical the perception of spatial coherence is by estimating the psychometric function for seventeen audio-visual stimuli. The results show that the maximum accepted offset angle does not depend on semantic categories but is linked to audio feature classes with harmonic sounds leading to greater acceptable offsets. A regression shows that the perceptual spectral centroid is negatively correlated with the offset angle and the slope of the psychometric spatial-coherence function. This finding, however, is not conclusive and further research is necessary to define all parameters that influence bimodal localization of realistic stimuli.
引用
收藏
页数:10
相关论文
共 50 条
  • [41] A JOINT AUDIO-VISUAL APPROACH TO AUDIO LOCALIZATION
    Jensen, Jesper Rindom
    Christensen, Mads Graesboll
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 454 - 458
  • [42] Speech extraction based on ica and audio-visual coherence
    Sodoyer, D
    Girin, L
    Jutten, C
    Schwartz, JL
    SEVENTH INTERNATIONAL SYMPOSIUM ON SIGNAL PROCESSING AND ITS APPLICATIONS, VOL 2, PROCEEDINGS, 2003, : 65 - 68
  • [43] Expressive audio-visual speech
    Bevacqua, E
    Pelachaud, C
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2004, 15 (3-4) : 297 - 304
  • [44] BUILDING AN AUDIO-VISUAL PROGRAM
    Forrester, Gertrude
    OCCUPATIONS-THE VOCATIONAL GUIDANCE JOURNAL, 1946, 25 (02): : 131 - 132
  • [45] Binaural Audio-Visual Localization
    Wu, Xinyi
    Wu, Zhenyao
    Ju, Lili
    Wang, Song
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 2961 - 2968
  • [46] Semantic Audio-Visual Navigation
    Chen, Changan
    Al-Halah, Ziad
    Grauman, Kristen
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 15511 - 15520
  • [47] Audio-visual materials in classics
    Siegel, Janice F.
    CLASSICAL WORLD, 2008, 101 (03) : 335 - 419
  • [48] The structure of audio-visual consciousness
    Skrzypulec, Blazej
    SYNTHESE, 2021, 198 (03) : 2101 - 2127
  • [49] Audio-Visual Methods in Teaching
    Hart, William G.
    EDUCATIONAL RESEARCH BULLETIN, 1954, 33 (06): : 162 - 163
  • [50] NEW AUDIO-VISUAL STUDENT
    MONODCASSIDY, H
    MODERN LANGUAGE JOURNAL, 1966, 50 (01): : 15 - 18