Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience

被引:117
作者
Ranasinghe, Nimesha [1 ]
Jain, Pravar [1 ]
Nguyen Thi Ngoc Tram [1 ]
Koh, Koon Chuan Raymond [2 ]
Tolley, David [1 ]
Karwita, Shienny [1 ]
Lin Lien-Ya [1 ]
Yan Liangkun [1 ]
Shamaiah, Kala [2 ]
Tung, Chow Eason Wai [1 ]
Yen, Ching Chiuan [1 ]
Do, Ellen Yi-Luen [1 ,3 ]
机构
[1] Natl Univ Singapore, Keio NUS CUTE Ctr, Smart Syst Inst, Singapore, Singapore
[2] ITE Coll Cent, Inst Tech Educ, Singapore, Singapore
[3] Univ Colorado, ATLAS Inst, Boulder, CO 80309 USA
来源
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018) | 2018年
基金
新加坡国家研究基金会;
关键词
Multisensory VR; Virtual Reality; Multimodal Interaction; OLFACTORY DISPLAY; ENVIRONMENTS;
D O I
10.1145/3173574.3174151
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the same way that we experience the real-world through a range of senses, experiencing a virtual environment through multiple sensory modalities may augment both our presence within a scenario and our reaction to it. In this paper, we present Season Traveller, a multisensory virtual reality (VR) narration of a journey through four seasons within a mystical realm. By adding olfactory and haptic (thermal and wind) stimuli, we extend traditional audio-visual VR technologies to achieve enhanced sensory engagement within interactive experiences. Using both subjective measures of presence and elicited physiological responses, we evaluated the impact of different modalities on the virtual experience. Our results indicate that 1) the addition of any singular modality improves sense of presence with respect to traditional audio-visual experiences and 2) providing a combination of these modalities produces a further significant enhancement over the aforementioned improvements. Furthermore, insights into participants' psychophysiology were extrapolated from electrodermal activity (EDA) and heart rate (HR) measurements during each of the VR experiences.
引用
收藏
页数:13
相关论文
共 53 条
  • [1] What's in a scent? Meaning, shape, and sensorial concepts elicited by scents
    Adams, Carmen
    Douce, Lieve
    [J]. JOURNAL OF SENSORY STUDIES, 2017, 32 (02)
  • [2] [Anonymous], 1992, PRESENCE-VIRTUAL AUG, DOI [10.1162/pres.1992.1.1.109, DOI 10.1162/PRES.1992.1.1.109]
  • [3] [Anonymous], 2008, GAME EXPERIENC UNPUB
  • [4] Babbitt Bettina A, 1989, TECHNICAL REPORT
  • [5] Cardenas S, 2007, PA STUD HUM RIGHTS, P101
  • [6] CATER JP, 1994, 1994 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS - HUMANS, INFORMATION AND TECHNOLOGY, VOLS 1-3, P1781, DOI 10.1109/ICSMC.1994.400108
  • [7] Critchley H., 2013, Electrodermal Activity (EDA), P666, DOI [DOI 10.1007/978-1-4419-1005-9_13, 10.1007/978-1-4419-1005-913, DOI 10.1007/978-1-4419-1005-913]
  • [8] The VR scooter: Wind and tactile feedback improve user performance
    Deligiannidis, Leonidas
    Jacob, Robert J. K.
    [J]. IEEE SYMPOSIUM ON 3D USER INTERFACES 2006, PROCEEDINGS, 2006, : 143 - +
  • [9] Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments
    Dinh, HQ
    Walker, N
    Hodges, LF
    Song, C
    Kobayashi, A
    [J]. IEEE VIRTUAL REALITY - PROCEEDINGS, 1999, : 222 - 228
  • [10] Virtual hell: A trip through the flames
    Dionisio, J
    [J]. IEEE COMPUTER GRAPHICS AND APPLICATIONS, 1997, 17 (03) : 11 - 14