The effect of distance on audiovisual temporal integration in an outdoor virtual environment

被引:0
|
作者
Fucci, Victoria [1 ]
Krol, Pelle [1 ]
Myrthe, Plaisier [1 ]
Cuijpers, Raymond H. [1 ]
机构
[1] Eindhoven Univ Technol, Dept Ind Engn & Innovat Sci, Eindhoven, Netherlands
关键词
Multisensory perception; Audiovisual and temporal integration; Synchrony judgements; Virtual reality; ORDER JUDGMENTS; MULTISENSORY INTEGRATION; PERCEPTION; TIME; RECALIBRATION; SYNCHRONY; SOUND;
D O I
10.1007/s10055-024-01064-2
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this study, we explore the influence of stimulus distance on human tolerance for (physical) asynchronies in virtual reality (VR). A repeated audiovisual (AV) stimulus with sound and light bursts was presented to the participants in an outdoor virtual environment (VE) using a head-mounted display (HMD). The investigation focused on quantifying the point of subjective simultaneity (PSS) for both visual and auditory stimuli. A synchrony judgment method (SJ-3) was used for 11 stimulus onset asynchronies (SOA) and five egocentric distances from 10 m up to 50 m with 10 m increments. The data analysis showed negative PSS values that decreased with distance, resulting in a negative slope (-3 ms/m) of the regression line between PSS values and simulated distances. In contrast to the recent study conducted in the indoor VE, we conclude that the presented study in the outdoor VE does not incorporate a distance compensation mechanism and refutes the hypothesis of an 'implicit estimation' of sound-arrival time. The reasons behind the observed contrast are discussed in this paper. Moreover, the negative slope of the regression line (-3 ms/m) is similar to previous research, concluding that there is a temporal integration of auditory-visual information within human neural processes without distance compensation.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Feasibility study of virtual reality in audiovisual environment: Assessment of university cafeteria acoustic environment
    Wen, Zehua
    Guo, Xiaoyang
    COMPUTER ANIMATION AND VIRTUAL WORLDS, 2024, 35 (02)
  • [32] The Different Effects of Selective Attention and Divided Attention on Audiovisual Temporal Integration
    Yang, Jingjing
    Li, Qi
    Li, Xiujun
    PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON ECONOMICS, MANAGEMENT ENGINEERING AND EDUCATION TECHNOLOGY (ICEMEET 2016), 2016, 87 : 1 - 5
  • [33] People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus
    Watson, Rebecca
    Latinus, Marianne
    Charest, Ian
    Crabbe, Frances
    Belin, Pascal
    CORTEX, 2014, 50 : 125 - 136
  • [34] The Role of Temporal Disparity on Audiovisual Integration in Low-Vision Individuals
    Targher, Stefano
    Micciolo, Rocco
    Occelli, Valeria
    Zampini, Massimiliano
    PERCEPTION, 2017, 46 (12) : 1356 - 1370
  • [35] Audiovisual temporal integration and rapid temporal recalibration in adolescents and adults: Age-related changes and its correlation with autistic traits
    Zhou, Han-yu
    Shi, Li-juan
    Yang, Han-xue
    Cheung, Eric F. C.
    Chan, Raymond C. K.
    AUTISM RESEARCH, 2020, 13 (04) : 615 - 626
  • [36] Interaction between auditory and visual perceptions on distance estimations in a virtual environment
    Paquier, Mathieu
    Cote, Nicolas
    Devillers, Frederic
    Koehl, Vincent
    APPLIED ACOUSTICS, 2016, 105 : 186 - 199
  • [37] Combining cues to judge distance and direction in an immersive virtual reality environment
    Scarfe, Peter
    Glennerster, Andrew
    JOURNAL OF VISION, 2021, 21 (04):
  • [38] The temporal precision of audiovisual integration is associated with longitudinal fall incidents but not sensorimotor fall risk in older adults
    O'Dowd, Alan
    Hirst, Rebecca J.
    Setti, Annalisa
    Donoghue, Orna A.
    Kenny, Rose Anne
    Newell, Fiona N.
    SCIENTIFIC REPORTS, 2023, 13 (01)
  • [39] The modulatory effect of semantic familiarity on the audiovisual integration of face-name pairs
    Li, Yuanqing
    Wang, Fangyi
    Huang, Biao
    Yang, Wanqun
    Yu, Tianyou
    Talsma, Durk
    HUMAN BRAIN MAPPING, 2016, 37 (12) : 4333 - 4348
  • [40] Audiovisual integration in human superior temporal sulcus: Inverse effectiveness and the neural processing of speech and object recognition
    Stevenson, Ryan A.
    James, Thomas W.
    NEUROIMAGE, 2009, 44 (03) : 1210 - 1223