The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 58 条
[1]   Synchronizing to real events: Subjective audiovisual alignment scales with perceived auditory depth and speed of sound [J].
Alais, D ;
Carlile, S .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (06) :2244-2247
[2]   SCALP TOPOGRAPHY OF HUMAN VISUAL EVOKED-POTENTIALS [J].
ALLISON, T ;
MATSUMIYA, Y ;
GOFF, GD ;
GOFF, WR .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1977, 42 (02) :185-197
[3]   Timing sight and sound [J].
Arnold, DH ;
Johnston, A ;
Nishida, S .
VISION RESEARCH, 2005, 45 (10) :1275-1284
[4]   Auditory distance perception in rooms [J].
Bronkhorst, AW ;
Houtgast, T .
NATURE, 1999, 397 (6719) :517-520
[5]   The Recalibration Effect of Time Perception Using a Virtual Environment [J].
Cha, Kyung-Ae ;
Hong, Sung-Bin ;
Woo, Sung-Ho ;
Kim, Hyun Taek .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2012, 21 (02) :203-212
[6]  
Cycling'74., 2021, Max/msp
[7]   Bimodal and trimodal multisensory enhancement: Effects of stimulus onset and intensity on reaction time [J].
Diederich, A ;
Colonius, H .
PERCEPTION & PSYCHOPHYSICS, 2004, 66 (08) :1388-1404
[8]   Video game players show more precise multisensory temporal processing abilities [J].
Donohue, Sarah E. ;
Woldorff, Marty G. ;
Mitroff, Stephen R. .
ATTENTION PERCEPTION & PSYCHOPHYSICS, 2010, 72 (04) :1120-1129
[9]  
Dragon Motion, 2016, Military field camp 3.2
[10]   VISUAL-AUDITORY DISTANCE CONSTANCY [J].
ENGEL, GR ;
DOUGHERTY, WG .
NATURE, 1971, 234 (5327) :308-+