Speech Emotion Recognition Based on Joint Self-Assessment Manikins and Emotion Labels

被引:6
作者
Chen, Jing-Ming [1 ]
Chang, Pao-Chi [1 ]
Liang, Kai-Wen [1 ]
机构
[1] Natl Cent Univ, Dept Commun Engn, Taoyuan, Taiwan
来源
2019 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2019) | 2019年
关键词
Speech emotion recognition; Self-Assessment Manikin; Deep learning; Convolutional recurrent neural network;
D O I
10.1109/ISM46123.2019.00073
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, we propose a system for speech emotion recognition based on regression models and classification models jointly. This speech emotion recognition technology can achieve the accuracy of 64.70% in the dataset of script and improvised mixed scenes. The accuracy can be up to 66.34% in the dataset with only improvised scenes. Compared to the state-of-art technology without the mental states, the accuracy of the proposed method is increased by 2.95% and 2.09% respect to improvised and mixed scenes. The results show that the characteristics of mental states can effectively improve the performance of speech emotion recognition.
引用
收藏
页码:327 / 330
页数:4
相关论文
共 50 条
  • [41] CONFIDENCE ESTIMATION FOR SPEECH EMOTION RECOGNITION BASED ON THE RELATIONSHIP BETWEEN EMOTION CATEGORIES AND PRIMITIVES
    Li, Yang
    Papayiannis, Constantinos
    Rozgic, Viktor
    Shriberg, Elizabeth
    Wang, Chao
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7352 - 7356
  • [42] SPEAKER NORMALIZATION FOR SELF-SUPERVISED SPEECH EMOTION RECOGNITION
    Gat, Itai
    Aronowitz, Hagai
    Zhu, Weizhong
    Morais, Edmilson
    Hoory, Ron
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7342 - 7346
  • [43] Self-labeling with feature transfer for speech emotion recognition
    Wen, Guihua
    Liao, Huiqiang
    Li, Huihui
    Wen, Pengchen
    Zhang, Tong
    Gao, Sande
    Wang, Bao
    KNOWLEDGE-BASED SYSTEMS, 2022, 254
  • [44] CycleGAN-based Emotion Style Transfer as Data Augmentation for Speech Emotion Recognition
    Bao, Fang
    Neumann, Michael
    Ngoc Thang Vu
    INTERSPEECH 2019, 2019, : 2828 - 2832
  • [45] Intelligent In-Car Emotion Regulation Interaction System Based on Speech Emotion Recognition
    Yang, Yuhan
    Zhang, Yan
    Zhong, Zhinan
    Dai, Wan
    Chen, Yunfei
    Chen, Mo
    2024 4TH INTERNATIONAL CONFERENCE ON COMPUTER, CONTROL AND ROBOTICS, ICCCR 2024, 2024, : 142 - 150
  • [46] ANN based Decision Fusion for Speech Emotion Recognition
    Xu, Lu
    Xu, Mingxing
    Yang, Dali
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 2003 - +
  • [47] Speech Emotion Recognition based on Multiple Feature Fusion
    Jiang, Changjiang
    Mao, Rong
    Liu, Geng
    Wang, Mingyi
    2019 CHINESE AUTOMATION CONGRESS (CAC2019), 2019, : 907 - 912
  • [48] Locality Preserved Joint Nonnegative Matrix Factorization for Speech Emotion Recognition
    Mathulaprangsan, Seksan
    Lee, Yuan-Shan
    Wang, Jia-Ching
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2019, E102D (04) : 821 - 825
  • [49] Speech Emotion Recognition Based on Acoustic Segment Model
    Zheng, Siyuan
    Du, Jun
    Zhou, Hengshun
    Bai, Xue
    Lee, Chin-Hui
    Li, Shipeng
    2021 12TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP), 2021,
  • [50] RECOGNITION OF EMOTION IN SPEECH USING VARIOGRAM BASED FEATURES
    Esmaileyan, Zeynab
    Marvi, Hosein
    MALAYSIAN JOURNAL OF COMPUTER SCIENCE, 2014, 27 (03) : 156 - 170