The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
|
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 50 条
  • [11] Musical training refines audiovisual integration but does not influence temporal recalibration
    O'Donohue, Matthew
    Lacherez, Philippe
    Yamamoto, Naohide
    SCIENTIFIC REPORTS, 2022, 12 (01)
  • [12] Audiovisual integration in depth: Modeling the effect of distance and stimulus effectiveness using the TWIN model
    Van der Stoep, Nathan
    Colonius, Hans
    Noel, Jean-Paul
    Wallace, Mark T.
    Diederich, Adele
    JOURNAL OF MATHEMATICAL PSYCHOLOGY, 2020, 99
  • [13] Audiovisual integration in near and far space: effects of changes in distance and stimulus effectiveness
    Van der Stoep, N.
    Van der Stigchel, S.
    Nijboer, T. C. W.
    Van der Smagt, M. J.
    EXPERIMENTAL BRAIN RESEARCH, 2016, 234 (05) : 1175 - 1188
  • [14] Audiovisual temporal integration of speech and gesture
    Margiotoudi, Konstantina
    Kelly, Spencer
    Vatakis, Argiro
    INTERNATIONAL CONFERENCE ON TIMING AND TIME PERCEPTION, 2014, 126 : 154 - +
  • [15] Effect of stimulus onset and offset asynchrony on audiovisual temporal recalibration
    Wang, Yaru
    Ichikawa, Makoto
    VISION RESEARCH, 2025, 230
  • [16] Temporal synchrony and audiovisual integration of speech and object stimuli in autism
    Smith, Elizabeth
    Zhang, Shouling
    Bennetto, Loisa
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2017, 39 : 11 - 19
  • [17] INVOLVEMENT OF SUPERIOR TEMPORAL AREAS IN AUDIOVISUAL AND AUDIOMOTOR SPEECH INTEGRATION
    Komeilipoor, N.
    Cesari, P.
    Daffertshofer, A.
    NEUROSCIENCE, 2017, 343 : 276 - 283
  • [18] An Approach to Reducing Distance Compression in Audiovisual Environment
    Finnegan, Daniel J.
    O'Neill, Eamonn
    Proulx, Michael J.
    2017 IEEE 3RD VR WORKSHOP ON SONIC INTERACTIONS FOR VIRTUAL ENVIRONMENTS (SIVE), 2017,
  • [19] Exposure to asynchronous audiovisual speech extends the temporal window for audiovisual integration
    Navarra, J
    Vatakis, A
    Zampini, M
    Soto-Faraco, S
    Humphreys, W
    Spence, C
    COGNITIVE BRAIN RESEARCH, 2005, 25 (02): : 499 - 507
  • [20] Temporal Ventriloquism Reveals Intact Audiovisual Temporal Integration in Amblyopia
    Richards, Michael D.
    Goltz, Herbert C.
    Wong, Agnes M. F.
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2018, 59 (02) : 637 - 643