Implementation of Attention-Based Spatial Audio for 360° Environments

被引：0
|
作者：
Nassani, Alaeddin [1 ]
Barde, Amit [1 ]
Bai, Huidong [1 ]
Nanayakkara, Suranga [1 ]
Billinghurst, Mark [1 ]
机构：
[1] Univ Auckland, Auckland, New Zealand
来源：
2022 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY ADJUNCT (ISMAR-ADJUNCT 2022) | 2022年
关键词：
VIDEO;
D O I：
10.1109/ISMAR-Adjunct57072.2022.00103
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this paper, we investigate the role of Attention-Based Spatial Audio in facilitating communication between people viewing 360 degrees environments. We created a web-based VR system to experiment with playing spatial audio from the direction in which the speaker is looking. The goal is to decrease cognitive load while increasing social presence and vocal intelligibility.
引用
收藏
页码：491 / 494
页数：4
相关论文
共 50 条
  • [1] Attention-Based LSTM Algorithm for Audio Replay Detection in Noisy Environments
    Li, Jiakang
    Zhang, Xiongwei
    Sun, Meng
    Zou, Xia
    Zheng, Changyan
    APPLIED SCIENCES-BASEL, 2019, 9 (08):
  • [2] Spatial Audio in 360° Videos: Does it influence Visual Attention?
    Hirway, Amit
    Qiao, Yuansong
    Murray, Niall
    PROCEEDINGS OF THE 13TH ACM MULTIMEDIA SYSTEMS CONFERENCE, MMSYS 2022, 2022, : 39 - 51
  • [3] A QoE and Visual Attention Evaluation on the Influence of Spatial Audio in 360 Videos
    Hirway, Amit
    Qiao, Yuansong
    Murray, Niall
    2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2020), 2020, : 345 - 350
  • [4] Evaluating Visual Attention and QoE for 360° videos with non-spatial and spatial audio
    Hirway, Amit
    Qiao, Yuansong
    Murray, Niall
    PROCEEDINGS OF THE 2024 15TH ACM MULTIMEDIA SYSTEMS CONFERENCE 2024, MMSYS 2024, 2024, : 532 - 535
  • [5] A Spatial Attention-Based Sensory Network for Fuzzy Controller of Mobile Robot in Dynamic Environments
    Shoji, Masaya
    Oshio, Kohei
    Hong, Chin Wei
    Saputra, Azhar Aulia
    Kubota, Naoyuki
    2022 IEEE INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS (FUZZ-IEEE), 2022,
  • [6] A Quality of Experience and Visual Attention Evaluation for 360 ° Videos with Non-spatial and Spatial Audio
    Hirway, Amit
    Qiao, Yuansong
    Murray, Niall
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (09)
  • [7] Attention-Based Audio-Visual Fusion for Video Summarization
    Fang, Yinghong
    Zhang, Junpeng
    Lu, Cewu
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 328 - 340
  • [8] Towards Attention-based Contrastive Learning for Audio Spoof Detection
    Goel, Chirag
    Koppisetti, Surya
    Colman, Ben
    Shahriyari, Ali
    Bharaj, Gaurav
    INTERSPEECH 2023, 2023, : 2758 - 2762
  • [9] Surveillance Audio Attention Model Based on Spatial Audio Cues
    Hang, Bo
    Hu, RuiMin
    Yang, YuHong
    Ma, Ye
    Chang, Jun
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2009, 2009, 5879 : 908 - +
  • [10] Attention-Based Deep Reinforcement Learning for Virtual Cinematography of 360° Videos
    Wang, Jianyi
    Xu, Mai
    Jiang, Lai
    Song, Yuhang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 3227 - 3238
12345