EMOTION RECOGNITION FROM PHYSIOLOGICAL SIGNALS USING MULTI-HYPERGRAPH NEURAL NETWORKS

被引:18
|
作者
Zhu, Junjie [1 ]
Zhao, Xibin [1 ]
Hu, Han [2 ]
Gao, Yue [1 ]
机构
[1] Tsinghua Univ, Sch Software, KLISS, BNRist, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Emotion Recognition; Physiological Signals; Multi-Modal Fusion; Multi-Hypergraph Neural Networks;
D O I
10.1109/ICME.2019.00111
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Emotion recognition from physiological signals is an effective way to discern the inner state of users. Existing works are lack in the exploration of latent correlation among multiple physiological signals and relationship among different subjects. To tackle this issue, we propose to recognize emotion from physiological signals using multi-hypergraph neural networks (MHGNN). In this method, the correlation among different subjects is formulated in the multi-hypergraph structure, where each type of physiological signal is used to generate one hypergraph. In each hypergraph, the hyperedges are used to represent the connections among the vertices (subject,stimuli). Thus, the emotion recognition task is modeled as classifying each vertex in the multi-hypergraph. Experimental results and comparisons with the state-of-the-art methods in the DEAP dataset demonstrate the superior performance of our method. The comparative experiments based on available biological knowledge verify that MHGNN can depict the real biological response process in a much more precise way.
引用
收藏
页码:610 / 615
页数:6
相关论文
共 50 条
  • [11] Emotion recognition using physiological signals
    Li, Lan
    Chen, Ji-hua
    ADVANCES IN ARTIFICIAL REALITY AND TELE-EXISTENCE, PROCEEDINGS, 2006, 4282 : 437 - +
  • [12] Emotion Recognition Using Physiological Signals
    Szwoch, Wioleta
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON MULTIMEDIA, INTERACTION, DESIGN AND INNOVATION, 2015,
  • [13] Emotion recognition from physiological signals
    Gouizi K.
    Bereksi Reguig F.
    Maaoui C.
    Journal of Medical Engineering and Technology, 2011, 35 (6-7): : 300 - 307
  • [14] Emotion recognition based on multimodal physiological signals using spiking feed-forward neural networks
    Yang, Xudong
    Yan, Hongli
    Zhang, Anguo
    Xu, Pan
    Pan, Sio Hang
    Vai, Mang I.
    Gao, Yueming
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2024, 91
  • [15] Multi-task Neural Networks for Personalized Pain Recognition from Physiological Signals
    Lopez-Martinez, Daniel
    Picard, Rosalind
    2017 SEVENTH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS (ACIIW), 2017, : 181 - 184
  • [16] Multi-componential Emotion Recognition in VR Using Physiological Signals
    Somarathna, Rukshani
    Quigley, Aaron
    Mohammadi, Gelareh
    AI 2022: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, 13728 : 599 - 613
  • [17] Emotion recognition using physiological signals from multiple subjects
    Li, Lan
    Chen, Ji-hua
    IIH-MSP: 2006 INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION HIDING AND MULTIMEDIA SIGNAL PROCESSING, PROCEEDINGS, 2006, : 355 - +
  • [18] Emotion Recognition Using Fused Physiological Signals
    Fabiano, Diego
    Canavan, Shaun
    2019 8TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION (ACII), 2019,
  • [19] A Review of Emotion Recognition Using Physiological Signals
    Shu, Lin
    Xie, Jinyan
    Yang, Mingyue
    Li, Ziyi
    Li, Zhenqi
    Liao, Dan
    Xu, Xiangmin
    Yang, Xinyi
    SENSORS, 2018, 18 (07)
  • [20] Recognition of Human Emotion using Radial Basis Function Neural Networks with Inverse Fisher Transformed Physiological Signals
    Abayomi, Abdultaofeek
    Olugbara, Oludayo O.
    Heukelman, Delene
    INTERNATIONAL JOURNAL OF INTEGRATED ENGINEERING, 2021, 13 (06): : 1 - 26