Deep attention based music genre classification

被引:50
作者
Yu, Yang [1 ]
Luo, Sen [2 ]
Liu, Shenglan [2 ]
Qiao, Hong [3 ]
Liu, Yang [2 ]
Feng, Lin [2 ]
机构
[1] Dalian Univ Technol, Sch Comp Sci & Technol, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, Sch Innovat & Enterpreneurship, Dalian 116024, Peoples R China
[3] Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Inst Automat, Beijing 100190, Peoples R China
关键词
Music genre classification; Deep neural networks; Serial attention; Parallelized attention; FEATURES; NETWORKS;
D O I
10.1016/j.neucom.2019.09.054
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
As an important component of music information retrieval, music genre classification attracts great attentions these years. Benefitting from the outstanding performance of deep neural networks in computer vision, some researchers apply CNN on music genre classification tasks with audio spectrograms as input instead, which has similarities with RGB images. These methods are based on a latent assumption that spectrums with different temporal steps have equal importance. However, it goes against the theory of processing bottleneck in psychology as well as our observation from audio spectrograms. By considering the differences of spectrums, we propose a new model incorporating with attention mechanism based on Bidirectional Recurrent Neural Network. Furthermore, two attention-based models (serial attention and parallelized attention) are implemented in this paper. Comparing with serial attention, parallelized attention is more flexible and gets better results in our experiments. Especially, the CNN-based parallelized attention models with taking STFT spectrograms as input outperform the previous work. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:84 / 91
页数:8
相关论文
共 52 条
[1]   Deep Scattering Spectrum [J].
Anden, Joakim ;
Mallat, Stephane .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (16) :4114-4128
[2]  
[Anonymous], 2014, ABS14091259 CORR
[3]  
[Anonymous], 1999, P INT COMP MUS C
[4]  
[Anonymous], 2006, Tech. Rep
[5]  
[Anonymous], 2010, P INT C DAT MIN APPL
[6]  
[Anonymous], LAT BREAK DEM 17 INT
[7]  
[Anonymous], 2017, 18 INT SOC MUS INF R
[8]  
[Anonymous], ARXIV150804025, DOI DOI 10.18653/V1/2021.FNDINGSEMNLP.101
[9]  
[Anonymous], 2013, IB C PATT REC
[10]  
[Anonymous], 2006, Tonal description of music audio signals