A review on emotion recognition from dialect speech using feature optimization and classification techniques

被引:2
作者
Thimmaiah, Sunil [1 ]
Vinay, N. A. [3 ]
Ravikumar, M. G. [1 ]
Prasad, S. R. [2 ]
机构
[1] Nagarjuna Coll Engn & Technol, Bengaluru, India
[2] KNS Inst Technol, Bengaluru, India
[3] Dayananda Sagar Coll Engn, Bengaluru, India
关键词
Emotion recognition; Dialect speech; Feature optimization; Classification techniques; Acoustic cues; Spectral features; Prosodic features; Temporal features; Support vector machines; Gaussian mixture models; Hidden Markov models; Machine learning; Convolutional neural networks; Long short-term memory networks; Feature selection; Dimensionality reduction; Principal component analysis; Recursive feature elimination; Datasets; Model generalization;
D O I
10.1007/s11042-024-18297-7
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Emotion recognition from speech has gained prominence across various domains due to its wide-ranging applications. This paper presents a comprehensive review of advancements in emotion recognition, focusing on dialect speech, through the utilization of feature optimization and classification techniques. Dialectal variations in speech introduce complexities that impact the accuracy of emotion recognition models. To address this challenge, diverse feature extraction methods have been explored, capturing both general and dialect-specific acoustic cues. Spectral, prosodic, and temporal features are adapted and optimized to enhance emotional content representation within dialect speech. Classification techniques play a pivotal role in distinguishing emotions in dialect speech. Traditional classifiers like Support Vector Machines (SVMs), Gaussian Mixture Models (GMMs), and Hidden Markov Models (HMMs) have been employed. Recent studies highlight the efficacy of machine learning approaches such as Random Forests, Gradient Boosting, Convolutional Neural Networks (CNNs), and Long Short-Term Memory networks (LSTMs). Feature selection and dimensionality reduction techniques optimize model performance. Principal Component Analysis (PCA), Recursive Feature Elimination (RFE), and genetic algorithms enhance feature sets, improving classification accuracy and computational efficiency. Datasets tailored for dialect-specific speech corpora address linguistic nuances and contribute to the model's relevance to distinct regions or communities. Challenges include limited labelled dialect emotion datasets, model generalization across multiple dialects, and ethical considerations. As the field evolves, striking a balance between performance and ethics remains imperative. This review underscores the promise of optimized feature extraction, innovative classification techniques, and tailored datasets in dialect-based emotion recognition.
引用
收藏
页码:73793 / 73793
页数:34
相关论文
共 50 条
[31]   Speech Based Emotion Recognition Using Spectral Feature Extraction and an Ensemble of kNN Classifiers [J].
Rieger, Steven A., Jr. ;
Muraleedharan, Rajani ;
Ramachandran, Ravi P. .
2014 9TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2014, :589-+
[32]   Emotion Recognition from Speech using Prosodic and Linguistic Features [J].
Pervaiz, Mahwish ;
Khan, Tamim Ahmed .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (08) :84-90
[33]   Feature extraction algorithms to improve the speech emotion recognition rate [J].
Koduru, Anusha ;
Valiveti, Hima Bindu ;
Budati, Anil Kumar .
INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2020, 23 (01) :45-55
[34]   Feature extraction algorithms to improve the speech emotion recognition rate [J].
Anusha Koduru ;
Hima Bindu Valiveti ;
Anil Kumar Budati .
International Journal of Speech Technology, 2020, 23 :45-55
[35]   Evolutionary feature selection for emotion recognition in multilingual speech analysis [J].
Brester, Christina ;
Semenkin, Eugene ;
Kovalev, Igor ;
Zelenkov, Pavel ;
Sidorov, Maxim .
2015 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2015, :2406-2411
[36]   EESpectrum Feature Representations for Speech Emotion Recognition [J].
Zhao, Ziping ;
Zhao, Yiqin ;
Bao, Zhongtian ;
Wang, Haishuai ;
Zhang, Zixing ;
Li, Chao .
PROCEEDINGS OF THE JOINT WORKSHOP OF THE 4TH WORKSHOP ON AFFECTIVE SOCIAL MULTIMEDIA COMPUTING AND FIRST MULTI-MODAL AFFECTIVE COMPUTING OF LARGE-SCALE MULTIMEDIA DATA (ASMMC-MMAC'18), 2018, :27-33
[37]   Dialect recognition from Telugu speech utterances using spectral and prosodic features [J].
Shivaprasad, S. ;
Sadanandam, M. .
INTERNATIONAL JOURNAL OF SPEECH TECHNOLOGY, 2021, 27 (2) :515-515
[38]   ENSEMBLE FEATURE SELECTION FOR DOMAIN ADAPTATION IN SPEECH EMOTION RECOGNITION [J].
Abdelwahab, Mohammed ;
Busso, Carlos .
2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, :5000-5004
[39]   Robust recognition of emotion from speech [J].
Hoque, Mohammed E. ;
Yeasin, Mohammed ;
Louwerse, Max M. .
INTELLIGENT VIRTUAL AGENTS, PROCEEDINGS, 2006, 4133 :42-53
[40]   Emotion Recognition from Speech Signal [J].
Ramdinmawii, Esther ;
Mohanta, Abhijit ;
Mittal, Vinay Kumar .
TENCON 2017 - 2017 IEEE REGION 10 CONFERENCE, 2017, :1562-1567