Disentangled Variational Autoencoder for Emotion Recognition in Conversations

被引:5
|
作者
Yang, Kailai [1 ]
Zhang, Tianlin [1 ]
Ananiadou, Sophia [1 ]
机构
[1] Univ Manchester, Dept Comp Sci, NaCTeM, Manchester M13 9PL, England
基金
英国生物技术与生命科学研究理事会;
关键词
Task analysis; Emotion recognition; Hidden Markov models; Context modeling; Decoding; Oral communication; Gaussian distribution; Emotion recognition in conversations; variational autoencoder; valence-arousal-dominance; disentangled representations; DIALOGUE;
D O I
10.1109/TAFFC.2023.3280038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise emotions leveraging contextual information. However, adjacent response generation ignores long-range dependencies and provides limited affective information in many cases. In addition, most ERC models learn a unified distributed representation for each utterance, which lacks interpretability and robustness. To address these issues, we propose a VAD-disentangled Variational AutoEncoder (VAD-VAE), which first introduces a target utterance reconstruction task based on Variational Autoencoder, then disentangles three affect representations Valence-Arousal-Dominance (VAD) from the latent space. We also enhance the disentangled representations by introducing VAD supervision signals from a sentiment lexicon and minimising the mutual information between VAD distributions. Experiments show that VAD-VAE outperforms the state-of-the-art model on two datasets. Further analysis proves the effectiveness of each proposed module and the quality of disentangled VAD representations.
引用
收藏
页码:508 / 518
页数:11
相关论文
共 50 条
  • [41] Flight maneuver intelligent recognition based on deep variational autoencoder network
    Tian, Wei
    Zhang, Hong
    Li, Hui
    Xiong, Yuan
    EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2022, 2022 (01)
  • [42] An extended variational autoencoder for cross-subject electromyograph gesture recognition
    Zhang, Zhen
    Ming, Yuewei
    Shen, Quming
    Wang, Yanyu
    Zhang, Yuhui
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 99
  • [43] An Evolutionary Optimized Variational Mode Decomposition for Emotion Recognition
    Khare, Smith K.
    Bajaj, Varun
    IEEE SENSORS JOURNAL, 2021, 21 (02) : 2035 - 2042
  • [44] Sensor-Based Transportation Mode Recognition Using Variational Autoencoder
    Zubayer Islam
    Mohamed Abdel-Aty
    Journal of Big Data Analytics in Transportation, 2021, 3 (1): : 15 - 26
  • [45] Flight maneuver intelligent recognition based on deep variational autoencoder network
    Wei Tian
    Hong Zhang
    Hui Li
    Yuan Xiong
    EURASIP Journal on Advances in Signal Processing, 2022
  • [46] Semisupervised Text Classification by Variational Autoencoder
    Xu, Weidi
    Tan, Ying
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (01) : 295 - 308
  • [47] Deep Sparse Autoencoder and Recursive Neural Network for EEG Emotion Recognition
    Li, Qi
    Liu, Yunqing
    Shang, Yujie
    Zhang, Qiong
    Yan, Fei
    ENTROPY, 2022, 24 (09)
  • [48] Low Latency Variational Autoencoder on FPGAs
    Que, Zhiqiang
    Zhang, Minghao
    Fan, Hongxiang
    Li, He
    Guo, Ce
    Luk, Wayne
    IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2024, 14 (02) : 323 - 333
  • [49] Novel Speech-Based Emotion Climate Recognition in Peers' Conversations Incorporating Affect Dynamics and Temporal Convolutional Neural Networks
    Alhussein, Ghada
    Alkhodari, Mohanad
    Khandoker, Ahsan H.
    Hadjileontiadis, Leontios J.
    IEEE ACCESS, 2025, 13 : 16752 - 16769
  • [50] Federated Multidomain Learning With Graph Ensemble Autoencoder GMM for Emotion Recognition
    Zhang, Chunjiong
    Li, Mingyong
    Wu, Di
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (07) : 7631 - 7641