MULTI-CONDITIONING AND DATA AUGMENTATION USING GENERATIVE NOISE MODEL FOR SPEECH EMOTION RECOGNITION IN NOISY CONDITIONS

被引:0
作者
Tiwari, Upasana [1 ]
Soni, Meet [1 ]
Chakraborty, Rupayan [1 ]
Panda, Ashish [1 ]
Kopparapu, Sunil Kumar [1 ]
机构
[1] TCS Res & Innovat, Mumbai, Maharashtra, India
来源
2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING | 2020年
关键词
Speech emotion recognition; noise robustness; generative noise model; multi conditioning; deep neural network;
D O I
10.1109/icassp40776.2020.9053581
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Degradation due to additive noise is a significant road block in the real-life deployment of Speech Emotion Recognition (SER) systems. Most of the previous work in this field dealt with the noise degradation either at the signal or at the feature level. In this paper, to address the robustness aspect of the SER in additive noise scenarios, we propose multi-conditioning and data augmentation using an utterance level parametric Generative noise model. The Generative noise model is designed to generate noise types which can span the entire noise space in the mel-filterbank energy domain. This characteristic of the model renders the system robust against unseen noise conditions. The generated noise types can be used to create multi-conditioned data for training the SER systems. Multi-conditioning approach can also be used to increase the training data by many folds where such data is limited. We report the performance of the proposed method on two datasets, namely EmoDB and IEMOCAP. We also explore multi-conditioning and data augmentation using noise samples from NOISEX-92 database.
引用
收藏
页码:7194 / 7198
页数:5
相关论文
共 18 条
  • [11] Pandharipande M, 2018, 2018 11TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), P324, DOI 10.1109/ISCSLP.2018.8706699
  • [12] Pandharipande M, 2018, EUR SIGNAL PR CONF, P2055, DOI 10.23919/EUSIPCO.2018.8553202
  • [13] Schuller B., 2006, Speech Prosody
  • [14] Speech Emotion Recognition Two Decades in a Nutshell, Benchmarks, and Ongoing Trends
    Schuller, Bjoern W.
    [J]. COMMUNICATIONS OF THE ACM, 2018, 61 (05) : 90 - 99
  • [15] Schuller Bjorn, 2007, IEEE INT C AC SPEECH, V4
  • [16] Generative Noise Modeling and Channel Simulation for Robust Speech Recognition in Unseen Conditions
    Soni, Meet
    Joshi, Sonal
    Panda, Ashish
    [J]. INTERSPEECH 2019, 2019, : 441 - 445
  • [17] Tawari A., 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P4605, DOI 10.1109/ICPR.2010.1132
  • [18] Yi Lu, 2019, P APSIPA