"When the Elephant Trumps": A Comparative Study on Spatial Audio for Orientation in 360 degrees Videos

被引:9
作者
Bala, Paulo [1 ,2 ]
Masu, Raul [1 ,2 ]
Nisi, Valentina [1 ,3 ]
Nunes, Nuno [1 ,4 ]
机构
[1] Madeira Interact Technol Inst, Funchal, Portugal
[2] Univ Nova Lisboa, Funchal, Portugal
[3] Univ Madeira, Funchal, Portugal
[4] Univ Lisbon, IST, Funchal, Portugal
来源
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS | 2019年
关键词
360 degrees video; Spatial Audio; Cinematic Virtual Reality; Orientation; Virtual Audio Spaces; SOUND;
D O I
10.1145/3290605.3300925
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Orientation is an emerging issue in cinematic Virtual Reality (VR), as viewers may fail in locating points of interest. Recent strategies to tackle this research problem have investigated the role of cues, specifically diegetic sound effects. In this paper, we examine the use of sound spatialization for orientation purposes, namely by studying different spatialization conditions ("none", "partial", and "full" spatial manipulation) of multitrack soundtracks. We performed a between-subject mixed-methods study with 36 participants, aided by Cue Control, a tool we developed for dynamic spatial sound editing and data collection/analysis. Based on existing literature on orientation cues in 360 degrees and theories on human listening, we discuss situations in which the spatialization was more effective (namely, "full" spatial manipulation both when using only music and when combining music and diegetic effects), and how this can be used by creators of 360 degrees videos.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Adeyemo A, 2016, IEEE INT ON LINE, P3, DOI 10.1109/IOLTS.2016.7604657
  • [2] [Anonymous], HDB MUSIC EMOTION TH
  • [3] [Anonymous], EURASIP J AUDIO SPEE
  • [4] [Anonymous], ICAD 2004 10 M INT C
  • [5] [Anonymous], MENSCH COMP 2016 TAG
  • [6] [Anonymous], TRACK GUIDE CONT FIL
  • [7] Begault Durand R, 2000, 3 SOUND VIRTUAL REAL
  • [8] Blattner M. M., 1989, Human-Computer Interaction, V4, P11, DOI 10.1207/s15327051hci0401_1
  • [9] Borji Ali, 2013, IEEE transactions on pattern analysis and machine intelligence, DOI DOI 10.1109/TPAMI.2012.89
  • [10] Braun V., 2006, QUAL RES PSYCHOL, V3, P77, DOI [DOI 10.1191/1478088706QP063OA, 10.1191/1478088706qp063oa]