Surveillance Audio Attention Model Based on Spatial Audio Cues

被引:0
|
作者
Hang, Bo [1 ,2 ]
Hu, RuiMin [2 ]
Yang, YuHong [2 ]
Ma, Ye [2 ]
Chang, Jun [3 ]
机构
[1] Xiangfan Univ, Xiangfan 441053, Peoples R China
[2] Wuhan Univ, Natl Engn Res Ctr Multimedia Software, Wuhan 430072, Peoples R China
[3] Wuhan Univ, Comp Sch, Wuhan 430072, Peoples R China
关键词
Audio attention; spatial audio; environment adaptive;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For stereo audio surveillance in complex environment, we proposed a bottom-up audio attention model based on spatial audio cues analysis. and an environment adaptive normalization method The traditional audio attention models are based on mono audio characters, such as energy, energy peak. or pitch Their performance is limited by neglecting the spatial in The spatial cues in audio stream provide additional information for attention analysis And the dynamic updated background sound can help to reduce the environment effect The preliminary experiment showed that the proposed model is an effective way to analyzing at events. which is caused by rapid moving sound source, in stereo audio stream
引用
收藏
页码:908 / +
页数:2
相关论文
共 50 条
  • [41] Projection-Based Demixing of Spatial Audio
    FitzGerald, Derry
    Liutkus, Antoine
    Badeau, Roland
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2016, 24 (09) : 1560 - 1572
  • [42] Varying microphone patterns for meeting speech segmentation using spatial audio cues
    Cheng, Eva
    Burnett, Ian
    Ritz, Christian
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2006, PROCEEDINGS, 2006, 4261 : 221 - +
  • [43] Joint modelling of audio-visual cues using attention mechanisms for emotion recognition
    Esam Ghaleb
    Jan Niehues
    Stylianos Asteriadis
    Multimedia Tools and Applications, 2023, 82 : 11239 - 11264
  • [44] Joint modelling of audio-visual cues using attention mechanisms for emotion recognition
    Ghaleb, Esam
    Niehues, Jan
    Asteriadis, Stylianos
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (08) : 11239 - 11264
  • [45] Audio Matters in Visual Attention
    Chen, Yanxiang
    Nguyen, Tam V.
    Kankanhalli, Mohan
    Yuan, Jun
    Yan, Shuicheng
    Wang, Meng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (11) : 1992 - 2003
  • [46] AUDITORY ATTENTION BASED MOBILE AUDIO QUALITY ASSESSMENT
    Yang Yuhong
    Yu Hongjiang
    Hu Ruimin
    Gao Li
    Wang Song
    Zhai Qing
    Xie Songbo
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [48] A QoE and Visual Attention Evaluation on the Influence of Spatial Audio in 360 Videos
    Hirway, Amit
    Qiao, Yuansong
    Murray, Niall
    2020 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2020), 2020, : 345 - 350
  • [49] VIDEO CODING BASED ON AUDIO-VISUAL ATTENTION
    Lee, Jong-Seok
    De Simone, Francesca
    Ebrahimi, Touradj
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 57 - 60
  • [50] Audio-visual dynamic remapping in an endogenous spatial attention task
    Fagioli, Sabrina
    Couyoumdjian, Alessandro
    Ferlazzo, Fabio
    BEHAVIOURAL BRAIN RESEARCH, 2006, 173 (01) : 30 - 38