Multisensory 360° Videos Under Varying Resolution Levels Enhance Presence

被引:4
作者
Covaci, Alexandra [1 ]
Saleme, Estevao B. [2 ]
Mesfin, Gebremariam [3 ]
Comsa, Ioan-Sorin [4 ]
Trestian, Ramona [5 ]
Santos, Celso A. S. [2 ]
Ghinea, George [6 ]
机构
[1] Univ Kent, Canterbury CT2 7NZ, England
[2] Fed Inst Espirito St, BR-29075910 Vitoria, Brazil
[3] Kristiania Univ Coll, N-0107 Oslo, Norway
[4] Swiss Distance Univ Appl Sci, CH-3900 Brig, Switzerland
[5] Middlesex Univ, London NW4 4BT, England
[6] Brunel Univ London, Uxbridge UB8 3PH, England
基金
欧盟地平线“2020”;
关键词
Multisensory; 360-degree videos; encoding quality; presence; mulsemedia; EXPERIENCE; QUESTIONNAIRES;
D O I
10.1109/TVCG.2022.3140875
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Omnidirectional videos have become a leading multimedia format for Virtual Reality applications. While live 360 degrees videos offer a unique immersive experience, streaming of omnidirectional content at high resolutions is not always feasible in bandwidth-limited networks. While in the case of flat videos, scaling to lower resolutions works well, 360 degrees video quality is seriously degraded because of the viewing distances involved in head-mounted displays. Hence, in this article, we investigate first how quality degradation impacts the sense of presence in immersive Virtual Reality applications. Then, we are pushing the boundaries of 360 degrees technology through the enhancement with multisensory stimuli. 48 participants experimented both 360 degrees scenarios (with and without multisensory content), while they were divided randomly between four conditions characterised by different encoding qualities (HD, FullHD, 2.5K, 4K). The results showed that presence is not mediated by streaming at a higher bitrate. The trend we identified revealed however that presence is positively and significantly impacted by the enhancement with multisensory content. This shows that multisensory technology is crucial in creating more immersive experiences.
引用
收藏
页码:2093 / 2101
页数:9
相关论文
共 56 条
[21]  
Le Callet P., 2012, PROC EUR NETW QUAL E, V3
[22]   360° Innovations for Panoramic Video Streaming [J].
Liu, Xing ;
Xiao, Qingyang ;
Gopalakrishnan, Vijay ;
Han, Bo ;
Qian, Feng ;
Varvello, Matteo .
HOTNETS-XVI: PROCEEDINGS OF THE 16TH ACM WORKSHOP ON HOT TOPICS IN NETWORKS, 2017, :50-56
[23]   Review of four studies on the use of physiological reaction as a measure of presence in stressful virtual environments [J].
Meehan, M ;
Razzaque, S ;
Insko, B ;
Whitton, M ;
Brooks, FP .
APPLIED PSYCHOPHYSIOLOGY AND BIOFEEDBACK, 2005, 30 (03) :239-258
[24]  
Meehan M, 2002, ACM T GRAPHIC, V21, P645, DOI 10.1145/566570.566630
[25]  
Murray N, 2017, INT WORK QUAL MULTIM
[26]  
Murray N, 2013, IEEE INT CON MULTI
[27]  
Paudyal P., 2016, MULTIMEDIA TOOLS APP, V75, p16 461
[28]   Taming the Latency in Multi-User VR 360°: A QoE-Aware Deep Learning-Aided Multicast Framework [J].
Perfecto, Cristina ;
Elbamby, Mohammed S. ;
Ser, Javier Del ;
Bennis, Mehdi .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2020, 68 (04) :2491-2508
[29]   Exploring the Use of Olfactory Stimuli Towards Reducing Visually Induced Motion Sickness in Virtual Reality [J].
Ranasinghe, Nimesha ;
Jain, Pravar ;
Tolley, David ;
Tailan, Shienny Karwita ;
Yen, Ching Chiuan ;
Yi-Luen, Ellen .
PROCEEDINGS OF THE 2020 ACM SYMPOSIUM ON SPATIAL USER INTERACTION, SUI 2020, 2020,
[30]   Season Traveller: Multisensory Narration for Enhancing the Virtual Reality Experience [J].
Ranasinghe, Nimesha ;
Jain, Pravar ;
Nguyen Thi Ngoc Tram ;
Koh, Koon Chuan Raymond ;
Tolley, David ;
Karwita, Shienny ;
Lin Lien-Ya ;
Yan Liangkun ;
Shamaiah, Kala ;
Tung, Chow Eason Wai ;
Yen, Ching Chiuan ;
Do, Ellen Yi-Luen .
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,