EMOTION RECOGNITION FROM PHYSIOLOGICAL SIGNALS USING MULTI-HYPERGRAPH NEURAL NETWORKS

被引:18
|
作者
Zhu, Junjie [1 ]
Zhao, Xibin [1 ]
Hu, Han [2 ]
Gao, Yue [1 ]
机构
[1] Tsinghua Univ, Sch Software, KLISS, BNRist, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Emotion Recognition; Physiological Signals; Multi-Modal Fusion; Multi-Hypergraph Neural Networks;
D O I
10.1109/ICME.2019.00111
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Emotion recognition from physiological signals is an effective way to discern the inner state of users. Existing works are lack in the exploration of latent correlation among multiple physiological signals and relationship among different subjects. To tackle this issue, we propose to recognize emotion from physiological signals using multi-hypergraph neural networks (MHGNN). In this method, the correlation among different subjects is formulated in the multi-hypergraph structure, where each type of physiological signal is used to generate one hypergraph. In each hypergraph, the hyperedges are used to represent the connections among the vertices (subject,stimuli). Thus, the emotion recognition task is modeled as classifying each vertex in the multi-hypergraph. Experimental results and comparisons with the state-of-the-art methods in the DEAP dataset demonstrate the superior performance of our method. The comparative experiments based on available biological knowledge verify that MHGNN can depict the real biological response process in a much more precise way.
引用
收藏
页码:610 / 615
页数:6
相关论文
共 50 条
  • [21] The Study of Emotion Recognition from Physiological Signals
    Li, Qing
    Yang, Zongkai
    Liu, Sanya
    Dai, Zhicheng
    Liu, Yang
    2015 SEVENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI), 2015, : 378 - 382
  • [22] Emotion Recognition using Short-Term Multi-Physiological Signals
    Kang, Tae-Koo
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2022, 16 (03): : 1076 - 1094
  • [23] Emotion Induction and Emotion Recognition using Their Physiological Signals Three Emotions and Recognition
    Park, Byoung-Jun
    Jang, Eun-Hye
    Kim, Sang-Hyeob
    Chung, Myoung-Ae
    2012 7TH INTERNATIONAL CONFERENCE ON COMPUTING AND CONVERGENCE TECHNOLOGY (ICCCT2012), 2012, : 1252 - 1255
  • [24] Emotion Recognition from Physiological Signals Using Parallel Stacked Autoencoders
    S. Bagherzadeh
    K. Maghooli
    J. Farhadi
    M. Zangeneh Soroush
    Neurophysiology, 2018, 50 : 428 - 435
  • [25] Physiological Inspired Deep Neural Networks for Emotion Recognition
    Ferreira, Pedro M.
    Marques, Filipe
    Cardoso, Jaime S.
    Rebelo, Ana
    IEEE ACCESS, 2018, 6 : 53930 - 53943
  • [26] Emotion Recognition from Physiological Signals Using Support Vector Machine
    Cheng, Bo
    SOFTWARE ENGINEERING AND KNOWLEDGE ENGINEERING: THEORY AND PRACTICE, VOL 1, 2012, 114 : 49 - 52
  • [27] Emotion Recognition from Physiological Signals Using Parallel Stacked Autoencoders
    Bagherzadeh, S.
    Maghooli, K.
    Farhadi, J.
    Soroush, M. Zangeneh
    NEUROPHYSIOLOGY, 2018, 50 (06) : 428 - 435
  • [28] A Convolution Neural Network Based Emotion Recognition System using Multimodal Physiological Signals
    Yang, Cheng-Jie
    Fahier, Nicolas
    Li, Wei-Chih
    Fang, Wai-Chi
    2020 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS - TAIWAN (ICCE-TAIWAN), 2020,
  • [29] Emotion recognition with multi-modal peripheral physiological signals
    Gohumpu, Jennifer
    Xue, Mengru
    Bao, Yanchi
    FRONTIERS IN COMPUTER SCIENCE, 2023, 5
  • [30] Emotion Recognition Using Neural Networks
    Unluturk, Mehmet S.
    Oguz, Kaya
    Atay, Coskun
    NN'09: PROCEEDINGS OF THE 10TH WSEAS INTERNATIONAL CONFERENCE ON NEURAL NETWORKS, 2009, : 82 - 85