A Review on Speech Emotion Recognition Using Deep Learning and Attention Mechanism

被引：107
作者：
Lieskovska, Eva [1 ]
Jakubec, Maros [1 ]
Jarina, Roman [1 ]
Chmulik, Michal [1 ]
机构：
[1] Univ Zilina, Fac Elect Engn & Informat Technol, Univ 8215-1, Zilina 01026, Slovakia
来源：
ELECTRONICS | 2021年 / 10卷 / 10期
关键词：
speech emotion recognition; deep learning; attention mechanism; recurrent neural network; long short-term memory; DATA AUGMENTATION; NEURAL-NETWORKS; FEATURES; AUDIO; CLASSIFIERS; PARAMETERS; DOMINANCE; DATABASES; AROUSAL; MODEL;
D O I：
10.3390/electronics10101163
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Emotions are an integral part of human interactions and are significant factors in determining user satisfaction or customer opinion. speech emotion recognition (SER) modules also play an important role in the development of human-computer interaction (HCI) applications. A tremendous number of SER systems have been developed over the last decades. Attention-based deep neural networks (DNNs) have been shown as suitable tools for mining information that is unevenly time distributed in multimedia content. The attention mechanism has been recently incorporated in DNN architectures to emphasise also emotional salient information. This paper provides a review of the recent development in SER and also examines the impact of various attention mechanisms on SER performance. Overall comparison of the system accuracies is performed on a widely used IEMOCAP benchmark database.
引用
收藏
页数：29
相关论文
共 112 条
[51]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[52]  
Kurpukdee N, 2017, ASIAPAC SIGN INFO PR, P1744, DOI 10.1109/APSIPA.2017.8282315
[53]  
Latif S., 2020, ARXIV171208708
[54]   Real-Time Speech Emotion Recognition Using a Pre-trained Image Classification Network: Effects of Bandwidth Reduction and Companding [J].
Lech, Margaret ;
Stolar, Melissa ;
Best, Christopher ;
Bolia, Robert .
FRONTIERS IN COMPUTER SCIENCE, 2020, 2
[55]  
Lee J, 2015, 16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5, P1537
[56]  
Li P., 2018, P INT 2018 HYD IND 2
[57]  
Li Y., 2019, P INTERSPEECH GRAZ A
[58]   Speech Emotion Recognition using Convolutional and Recurrent Neural Networks [J].
Lim, Wootaek ;
Jang, Daeyoung ;
Lee, Taejin .
2016 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA), 2016,
[59]  
Liu G., 2018, arXiv
[60]   Speech emotion recognition based on feature selection and extreme learning machine decision tree [J].
Liu, Zhen-Tao ;
Wu, Min ;
Cao, Wei-Hua ;
Mao, Jun-Wei ;
Xu, Jian-Ping ;
Tan, Guan-Zheng .
NEUROCOMPUTING, 2018, 273 :271-280
12345678910