The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
|
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Audiovisual illusion training improves multisensory temporal integration
    Zhu, Haocheng
    Tang, Xiaoyu
    Chen, Tingji
    Yang, Jiajia
    Wang, Aijun
    Zhang, Ming
    CONSCIOUSNESS AND COGNITION, 2023, 109
  • [2] The effect of movement speed on audiovisual temporal integration in streaming-bouncing illusion
    Wang, Luning
    Lin, Liyue
    Sun, Yujia
    Hou, Shuang
    Ren, Jie
    EXPERIMENTAL BRAIN RESEARCH, 2022, 240 (04) : 1139 - 1149
  • [3] Best Distance Perception in Virtual Audiovisual Environment
    Song, Hui
    Ma, Ke
    COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [4] The Effect of Temporal Alignment on Audiovisual Integration in a Divided Attention Task
    Yang, Jingjing
    Li, Xiujun
    Li, Qi
    Zhao, Xiaojun
    Wu, Jinglong
    Li, Lingjun
    2015 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2015, : 865 - 870
  • [5] Audiovisual integration in depth: multisensory binding and gain as a function of distance
    Noel, Jean-Paul
    Modi, Kahan
    Wallace, Mark T.
    Van der Stoep, Nathan
    EXPERIMENTAL BRAIN RESEARCH, 2018, 236 (07) : 1939 - 1951
  • [6] The Effect of Temporal Asynchrony on Audiovisual Integration
    Yang, Jingjing
    Li, Xiujun
    Li, Qi
    Wu, Jinglong
    2016 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, 2016, : 2338 - 2343
  • [7] Audiovisual Integration Varies With Target and Environment Richness in Immersive Virtual Reality
    Bailey, Hudson Diggs
    Mullaney, Aidan B.
    Gibney, Kyla D.
    Kwakye, Leslie Dowell
    MULTISENSORY RESEARCH, 2018, 31 (07) : 689 - 713
  • [8] Compensating for Distance Compression in Audiovisual Virtual Environments Using Incongruence
    Finnegan, Daniel J.
    O'Neill, Eamonn
    Proulx, Michael J.
    34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, : 200 - 212
  • [9] Audiovisual temporal integration in reverberant environments
    Eg, Ragnhild
    Behne, Dawn
    Griwodz, Carsten
    SPEECH COMMUNICATION, 2015, 66 : 91 - 106
  • [10] Integration and Temporal Processing of Asynchronous Audiovisual Speech
    Simon, David M.
    Wallace, Mark T.
    JOURNAL OF COGNITIVE NEUROSCIENCE, 2018, 30 (03) : 319 - 337