The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
|
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Neural mechanisms for the effect of prior knowledge on audiovisual integration
    Liu, Qiang
    Zhang, Ye
    Campos, Jennifer L.
    Zhang, Qinglin
    Sun, Hong-Jin
    BIOLOGICAL PSYCHOLOGY, 2011, 87 (02) : 200 - 208
  • [22] Audiovisual speech integration in the brain: Semantics and temporal synchrony
    Tsilionis, Efthymios
    Vatakis, Argiro
    INTERNATIONAL CONFERENCE ON TIMING AND TIME PERCEPTION, 2014, 126 : 160 - 161
  • [23] Comparison for younger and older adults: Stimulus temporal asynchrony modulates audiovisual integration
    Ren, Yanna
    Ren, Yanling
    Yang, Weiping
    Tang, Xiaoyu
    Wu, Fengxia
    Wu, Qiong
    Takahashi, Satoshi
    Ejima, Yoshimichi
    Wu, Jinglong
    INTERNATIONAL JOURNAL OF PSYCHOPHYSIOLOGY, 2018, 124 : 1 - 11
  • [24] Audiovisual integration in depth: multisensory binding and gain as a function of distance
    Jean-Paul Noel
    Kahan Modi
    Mark T. Wallace
    Nathan Van der Stoep
    Experimental Brain Research, 2018, 236 : 1939 - 1951
  • [25] Depth Perception in Virtual Reality Systems: Effect of Screen Distance, Environment Richness and Display Factors
    Vienne, Cyril
    Masfrand, Stephane
    Bourdin, Christophe
    Vercher, Jean-Louis
    IEEE ACCESS, 2020, 8 (08): : 29099 - 29110
  • [26] Audiovisual temporal integration: Cognitive processing, neural mechanisms, developmental trajectory and potential interventions
    Zhou, Han-yu
    Cheung, Eric F. C.
    Chan, Raymond C. K.
    NEUROPSYCHOLOGIA, 2020, 140
  • [27] No effect of spatial congruence on rapid temporal recalibration to audiovisual asynchrony
    Uno, Kyuto
    Hidaka, Souta
    PSYCHONOMIC BULLETIN & REVIEW, 2024, 31 (04) : 1615 - 1626
  • [28] AUDIOVISUAL SPEECH INTEGRATION IN THE SUPERIOR TEMPORAL REGION IS DYSFUNCTIONAL IN DYSLEXIA
    Ye, Zheng
    Ruesseler, Jascha
    Gerth, Ivonne
    Muente, Thomas F.
    NEUROSCIENCE, 2017, 356 : 1 - 10
  • [29] An intelligent virtual environment for distance learning
    dos Santos, CT
    Osório, FS
    EDUTECH: WHERE COMPUTER-AIDED DESIGN MEETS COMPUTER-AIDED LEARNING, 2004, 151 : 143 - 153
  • [30] Audiovisual Integration During Joint Action: No Effects for Motion Discrimination and Temporal Order Judgment Tasks
    Wahn, Basil
    Dosso, Jill A.
    Kingstone, Alan
    FRONTIERS IN PSYCHOLOGY, 2020, 11