An Enhanced Emotion Recognition Algorithm Using Pitch Correlogram, Deep Sparse Matrix Representation and Random Forest Classifier

被引:6
作者
Hamsa, Shibani [1 ]
Iraqi, Youssef [1 ]
Shahin, Ismail [2 ]
Werghi, Naoufel [1 ]
机构
[1] Khalifa Univ Sci Technol & Res, Ctr Cyber Phys Syst C2PS, Dept Elect & Comp Engn ECE, Abu Dhabi, U Arab Emirates
[2] Univ Sharjah, Dept Elect Engn, Sharjah, U Arab Emirates
关键词
Emotion recognition; Feature extraction; Mel frequency cepstral coefficient; Noise reduction; Speech recognition; Hidden Markov models; Computational modeling; feature extraction; noise reduction; random forest classifier; SPEECH; SPEAKER; IDENTIFICATION; FEATURES;
D O I
10.1109/ACCESS.2021.3086062
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work presents an approach for text-independent and speaker-independent emotion recognition from speech in real application situations such as noisy and stressful talking conditions. We have incorporated a new way for feature extraction, representation, and noise reduction, replacing the frequently used cepstral features in the literature. The proposed algorithm is modeled as the combination of pitch-correlogram-based noise reduction pre-processing module, sparse-dense decomposition-based feature representation, and random forest classifier. The work is assessed in terms of efficiency and computational complexity using English and Arabic datasets corresponding to noisy and stressful talking conditions. Our system yields significant improvement in results in comparison with other techniques based on the same classifier model. The proposed network architecture achieves significant rise in performance correspond to the recent literature on benchmark datasets.
引用
收藏
页码:87995 / 88010
页数:16
相关论文
共 47 条
[31]  
Rawat A., 2015, International Journal of Advanced Research in Computer Science and Software Engineering, V5, P422
[32]   Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge [J].
Schuller, Bjorn ;
Batliner, Anton ;
Steidl, Stefan ;
Seppi, Dino .
SPEECH COMMUNICATION, 2011, 53 (9-10) :1062-1087
[33]   Emotion Recognition Using Hybrid Gaussian Mixture Model and Deep Neural Network [J].
Shahin, Ismail ;
Nassif, Ali Bou ;
Hamsa, Shibani .
IEEE ACCESS, 2019, 7 :26777-26787
[34]   Talking condition recognition in stressful and emotional talking environments based on CSPHMM2s [J].
Shahin I. ;
Ba-Hutair M.N. .
International Journal of Speech Technology, 2014, 18 (01) :77-90
[35]   Studying and enhancing talking condition recognition in stressful and emotional talking environments based on HMMs, CHMM2s and SPHMMs [J].
Shahin, Ismail .
JOURNAL ON MULTIMODAL USER INTERFACES, 2012, 6 (1-2) :59-71
[36]   A Subspace Projection Approach for Analysis of Speech Under Stressed Condition [J].
Shukla, Sumitra ;
Dandapat, S. ;
Prasanna, S. R. Mahadeva .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2016, 35 (12) :4486-4500
[37]  
Stuhlsatz A, 2011, INT CONF ACOUST SPEE, P5688
[38]   Hierarchical sparse coding framework for speech emotion recognition [J].
Torres-Boza, Diana ;
Oveneke, Meshia Cedric ;
Wang, Fengna ;
Jiang, Dongmei ;
Verhelst, Werner ;
Sahli, Hichem .
SPEECH COMMUNICATION, 2018, 99 :80-89
[39]   A kurtosis-based dynamic approach to Gaussian mixture modeling [J].
Vlassis, N ;
Likas, A .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 1999, 29 (04) :393-399
[40]  
Vogt T., 2006, P LANG RES EV C LREC, P1123