The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
|
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] The impact of temporal and spatial consistency of audiovisual stimuli on Pip-and-Pop effect
    Tang, Xiaoyu
    Cui, Xinzhong
    Gao, Min
    Yuan, Mengying
    ACTA PSYCHOLOGICA SINICA, 2022, 54 (11) : 1310 - 1324
  • [42] Effect of infant bilingualism on audiovisual integration in a McGurk task
    Mercure, Evelyne
    Bright, Peter
    Quiroz, Isabel
    Filippi, Roberto
    JOURNAL OF EXPERIMENTAL CHILD PSYCHOLOGY, 2022, 217
  • [43] Effect of auditory stimulus on distance compression in virtual reality
    Hu Xiaofei
    Wang Jiawci
    Liu Hanyu
    Song Xiaolei
    ACTA PSYCHOLOGICA SINICA, 2023, 55 (01) : 1 - 8
  • [44] Gone in a flash: manipulation of audiovisual temporal integration using transcranial magnetic stimulation
    Hamilton, Roy H.
    Wiener, Martin
    Drebing, Daniel E.
    Coslett, H. Branch
    FRONTIERS IN PSYCHOLOGY, 2013, 4
  • [45] Computing an optimal time window of audiovisual integration in focused attention tasks: illustrated by studies on effect of age and prior knowledge
    Colonius, Hans
    Diederich, Adele
    EXPERIMENTAL BRAIN RESEARCH, 2011, 212 (03) : 327 - 337
  • [46] Autistic Communication and Imagination Sub-Traits Are Related to Audiovisual Temporal Integration in the Stream-Bounce Illusion
    Yaguchi, Ayako
    Hidaka, Souta
    MULTISENSORY RESEARCH, 2021, 34 (05) : 477 - 492
  • [47] Pshychological influences on distance estimation in a virtual reality environment
    Takahashi, Kohske
    Meilinger, Tobias
    Watanabe, Katsumi
    Buelthoff, Heinrich H.
    FRONTIERS IN HUMAN NEUROSCIENCE, 2013, 7
  • [48] Distinct cortical locations for integration of audiovisual speech and the McGurk effect
    Erickson, Laura C.
    Zielinski, Brandon A.
    Zielinski, Jennifer E. V.
    Liu, Guoying
    Turkeltaub, Peter E.
    Leaver, Amber M.
    Rauschecker, Josef P.
    FRONTIERS IN PSYCHOLOGY, 2014, 5
  • [49] The effect of spatial–temporal audiovisual disparities on saccades in a complex scene
    Marc M. Van Wanrooij
    Andrew H. Bell
    Douglas P. Munoz
    A. John Van Opstal
    Experimental Brain Research, 2009, 198 : 425 - 437
  • [50] Temporal gap between visual and auditory stimuli lessen audiovisual integration in aging under cross-modal attention
    Ren, Yan-Na
    Yang, Weiping
    Takahashi, Satoshi
    Nakahashi, Kohei
    Wu, Jinglong
    2015 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2015, : 511 - 516