EMOTION RECOGNITION FROM PHYSIOLOGICAL SIGNALS USING MULTI-HYPERGRAPH NEURAL NETWORKS

被引:18
|
作者
Zhu, Junjie [1 ]
Zhao, Xibin [1 ]
Hu, Han [2 ]
Gao, Yue [1 ]
机构
[1] Tsinghua Univ, Sch Software, KLISS, BNRist, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Emotion Recognition; Physiological Signals; Multi-Modal Fusion; Multi-Hypergraph Neural Networks;
D O I
10.1109/ICME.2019.00111
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Emotion recognition from physiological signals is an effective way to discern the inner state of users. Existing works are lack in the exploration of latent correlation among multiple physiological signals and relationship among different subjects. To tackle this issue, we propose to recognize emotion from physiological signals using multi-hypergraph neural networks (MHGNN). In this method, the correlation among different subjects is formulated in the multi-hypergraph structure, where each type of physiological signal is used to generate one hypergraph. In each hypergraph, the hyperedges are used to represent the connections among the vertices (subject,stimuli). Thus, the emotion recognition task is modeled as classifying each vertex in the multi-hypergraph. Experimental results and comparisons with the state-of-the-art methods in the DEAP dataset demonstrate the superior performance of our method. The comparative experiments based on available biological knowledge verify that MHGNN can depict the real biological response process in a much more precise way.
引用
收藏
页码:610 / 615
页数:6
相关论文
共 50 条
  • [1] Multi-hypergraph Neural Networks for Emotion Recognition in Multi-party Conversations
    Zheng, Cheng
    Xu, Haojie
    Sun, Xiao
    MAN-MACHINE SPEECH COMMUNICATION, NCMMSC 2022, 2023, 1765 : 44 - 58
  • [2] Multi-Hypergraph Neural Networks for Emotion Recognition in Multi-Party Conversations
    Xu, Haojie
    Zheng, Cheng
    Zhao, Zhuoer
    Sun, Xiao
    APPLIED SCIENCES-BASEL, 2023, 13 (03):
  • [3] Emotion Recognition Based on Physiological Signals Using Convolution Neural Networks
    Song, Tongshuai
    Lu, Guanming
    Yan, Jingjie
    ICMLC 2020: 2020 12TH INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND COMPUTING, 2018, : 161 - 165
  • [4] Online multi-hypergraph fusion learning for cross-subject emotion recognition
    Pan, Tongjie
    Ye, Yalan
    Zhang, Yangwuyong
    Xiao, Kunshu
    Cai, Hecheng
    INFORMATION FUSION, 2024, 108
  • [5] RESIDUAL ENHANCED MULTI-HYPERGRAPH NEURAL NETWORK
    Huang, Jing
    Huang, Xiaolin
    Yang, Jie
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 3657 - 3661
  • [6] MHG-ERC: Multi-hypergraph Feature Aggregation Network for Emotion Recognition in Conversations
    Zheng, Cheng
    Xu, Haojie
    Sun, Xiao
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2023, 22 (10)
  • [7] Emotion Recognition from EEG Signals Using Recurrent Neural Networks
    Chowdary, M. Kalpana
    Anitha, J.
    Hemanth, D. Jude
    ELECTRONICS, 2022, 11 (15)
  • [8] Emotion Recognition from Physiological Signals Using AdaBoost
    Cheng, Bo
    APPLIED INFORMATICS AND COMMUNICATION, PT I, 2011, 224 : 412 - 417
  • [9] Emotion Recognition from Physiological Signals Using AdaBoost
    Cheng, Bo
    2010 THE 3RD INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND INDUSTRIAL APPLICATION (PACIIA2010), VOL I, 2010, : 233 - 235
  • [10] Using Physiological Signals for Emotion Recognition
    Szwoch, Wioleta
    2013 6TH INTERNATIONAL CONFERENCE ON HUMAN SYSTEM INTERACTIONS (HSI), 2013, : 556 - 561