The Plausibility of a String Quartet Performance in Virtual Reality

被引:54
作者
Bergstrom, Ilias [1 ]
Azevedo, Sergio [2 ]
Papiotis, Panos [3 ]
Saldanha, Nuno [2 ]
Slater, Mel [4 ,5 ,6 ]
机构
[1] KTH Royal Inst Technol, Stockholm, Sweden
[2] Microsoft Language Dev Ctr, Lisbon, Portugal
[3] Univ Pompeu Fabra, Barcelona, Spain
[4] Univ Barcelona, E-08007 Barcelona, Spain
[5] ICREA, E-08007 Barcelona, Spain
[6] UCL, London, England
关键词
Presence; plausibility; place illusion; user studies; experimental methods; multimodal interaction; entertainment; ENHANCES REALISTIC RESPONSE; ENVIRONMENTS; PSYCHOPHYSICS; SENSE; MUSINGS; INPUT;
D O I
10.1109/TVCG.2017.2657138
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We describe an experiment that explores the contribution of auditory and other features to the illusion of plausibility in a virtual environment that depicts the performance of a string quartet. 'Plausibility' refers to the component of presence that is the illusion that the perceived events in the virtual environment are really happening. The features studied were: Gaze (the musicians ignored the participant, the musicians sometimes looked towards and followed the participant's movements), Sound Spatialization (Mono, Stereo, Spatial), Auralization (no sound reflections, reflections corresponding to a room larger than the one perceived, reflections that exactly matched the virtual room), and Environment (no sound from outside of the room, birdsong and wind corresponding to the outside scene). We adopted the methodology based on color matching theory, where 20 participants were first able to assess their feeling of plausibility in the environment with each of the four features at their highest setting. Then five times participants started from a low setting on all features and were able to make transitions from one system configuration to another until they matched their original feeling of plausibility. From these transitions a Markov transition matrix was constructed, and also probabilities of a match conditional on feature configuration. The results show that Environment and Gaze were individually the most important factors influencing the level of plausibility. The highest probability transitions were to improve Environment and Gaze, and then Auralization and Spatialization. We present this work as both a contribution to the methodology of assessing presence without questionnaires, and showing how various aspects of a musical performance can influence plausibility.
引用
收藏
页码:1332 / 1339
页数:8
相关论文
共 46 条
[1]  
Andre Ceprie, 2010, 2010 International Conference on Audio, Language and Image Processing (ICALIP), P130, DOI 10.1109/ICALIP.2010.5684993
[2]  
[Anonymous], 1992, PRESENCE-VIRTUAL AUG, DOI [10.1162/pres.1992.1.1.109, DOI 10.1162/PRES.1992.1.1.109]
[3]  
[Anonymous], 2014, A first course in stochastic processes
[4]   Combining EEG Data with Place and Plausibility Responses as an Approach to Measuring Presence in Outdoor Virtual Environments [J].
Azevedo, Antonio Sergio ;
Jorge, Joaquim ;
Campos, Pedro .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2015, 23 (04) :354-368
[5]   Interpersonal distance in immersive virtual environments [J].
Bailenson, JN ;
Blascovich, J ;
Beall, AC ;
Loomis, JM .
PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 2003, 29 (07) :819-833
[6]   Presence in virtual environments as a function of type of input device and display update rate [J].
Barfield, W ;
Baird, KM ;
Bjorneseth, OJ .
DISPLAYS, 1998, 19 (02) :91-98
[7]  
Barfield W., 1995, J VIRTUAL REALITY SO, V1, P3, DOI DOI 10.1007/BF02009709
[8]   Presence and the utility of audio spatialization [J].
Bormann, K .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2005, 14 (03) :278-297
[9]   How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence [J].
Cummings, James J. ;
Bailenson, Jeremy N. .
MEDIA PSYCHOLOGY, 2016, 19 (02) :272-309
[10]   Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments [J].
Dinh, HQ ;
Walker, N ;
Hodges, LF ;
Song, C ;
Kobayashi, A .
IEEE VIRTUAL REALITY - PROCEEDINGS, 1999, :222-228