Multisensory 360° Videos Under Varying Resolution Levels Enhance Presence

被引:4
作者
Covaci, Alexandra [1 ]
Saleme, Estevao B. [2 ]
Mesfin, Gebremariam [3 ]
Comsa, Ioan-Sorin [4 ]
Trestian, Ramona [5 ]
Santos, Celso A. S. [2 ]
Ghinea, George [6 ]
机构
[1] Univ Kent, Canterbury CT2 7NZ, England
[2] Fed Inst Espirito St, BR-29075910 Vitoria, Brazil
[3] Kristiania Univ Coll, N-0107 Oslo, Norway
[4] Swiss Distance Univ Appl Sci, CH-3900 Brig, Switzerland
[5] Middlesex Univ, London NW4 4BT, England
[6] Brunel Univ London, Uxbridge UB8 3PH, England
基金
欧盟地平线“2020”;
关键词
Multisensory; 360-degree videos; encoding quality; presence; mulsemedia; EXPERIENCE; QUESTIONNAIRES;
D O I
10.1109/TVCG.2022.3140875
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Omnidirectional videos have become a leading multimedia format for Virtual Reality applications. While live 360 degrees videos offer a unique immersive experience, streaming of omnidirectional content at high resolutions is not always feasible in bandwidth-limited networks. While in the case of flat videos, scaling to lower resolutions works well, 360 degrees video quality is seriously degraded because of the viewing distances involved in head-mounted displays. Hence, in this article, we investigate first how quality degradation impacts the sense of presence in immersive Virtual Reality applications. Then, we are pushing the boundaries of 360 degrees technology through the enhancement with multisensory stimuli. 48 participants experimented both 360 degrees scenarios (with and without multisensory content), while they were divided randomly between four conditions characterised by different encoding qualities (HD, FullHD, 2.5K, 4K). The results showed that presence is not mediated by streaming at a higher bitrate. The trend we identified revealed however that presence is positively and significantly impacted by the enhancement with multisensory content. This shows that multisensory technology is crucial in creating more immersive experiences.
引用
收藏
页码:2093 / 2101
页数:9
相关论文
共 56 条
[1]   Audio Masking Effect on Inter-Component Skews in Olfaction-Enhanced Multimedia Presentations [J].
Ademoye, Oluwakemi A. ;
Murray, Niall ;
Muntean, Gabriel-Miro ;
Ghinea, Gheorghita .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2016, 12 (04)
[2]   Information Recall Task Impact in Olfaction-Enhanced Multimedia [J].
Ademoye, Oluwakemi A. ;
Ghinea, Gheorghita .
ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2013, 9 (03)
[3]   Synchronization of Olfaction-Enhanced Multimedia [J].
Ademoye, Oluwakemi A. ;
Ghinea, Gheorghita .
IEEE TRANSACTIONS ON MULTIMEDIA, 2009, 11 (03) :561-565
[4]   A Neuroscience Approach to Virtual Reality Experience Using Transcranial Doppler Monitoring [J].
Alcaniz, Mariano ;
Rey, Beatriz ;
Tembl, Jose ;
Parkhutik, Vera .
PRESENCE-TELEOPERATORS AND VIRTUAL ENVIRONMENTS, 2009, 18 (02) :97-111
[5]  
Bao YN, 2016, 2016 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), P1161, DOI 10.1109/BigData.2016.7840720
[6]  
Cisco V., 2018, Cisco visual networking index: Forecast and trends, 2017-2022
[7]   Do I Smell Coffee? The Tale of a 360° Mulsemedia Experience [J].
Comsa, Ioan-Sorin ;
Saleme, Estevao Bissoll ;
Covaci, Alexandra ;
Assres, Gebremariam Mesfin ;
Trestian, Ramona ;
Santos, Celso A. S. ;
Ghinea, Gheorghita .
IEEE MULTIMEDIA, 2020, 27 (01) :27-36
[8]   360 degrees Mulsemedia: A Way to Improve Subjective QoE in 360 degrees Videos [J].
Covaci, Alexandra ;
Trestian, Ramona ;
Saleme, Estevao Bissoli ;
Comsa, Ioan-Sorin ;
Assres, Gebremariam ;
Santos, Celso A. S. ;
Ghinea, Gheorghita .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2378-2386
[9]   Is Multimedia Multisensorial? - A Review of Mulsemedia Systems [J].
Covaci, Alexandra ;
Zou, Longhao ;
Tal, Irina ;
Muntean, Gabriel-Miro ;
Ghinea, Gheorghita .
ACM COMPUTING SURVEYS, 2019, 51 (05)
[10]   Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments [J].
Dinh, HQ ;
Walker, N ;
Hodges, LF ;
Song, C ;
Kobayashi, A .
IEEE VIRTUAL REALITY - PROCEEDINGS, 1999, :222-228