EMOTION RECOGNITION FROM PHYSIOLOGICAL SIGNALS USING MULTI-HYPERGRAPH NEURAL NETWORKS

被引:18
|
作者
Zhu, Junjie [1 ]
Zhao, Xibin [1 ]
Hu, Han [2 ]
Gao, Yue [1 ]
机构
[1] Tsinghua Univ, Sch Software, KLISS, BNRist, Beijing 100084, Peoples R China
[2] Beijing Inst Technol, Sch Informat & Elect, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
Emotion Recognition; Physiological Signals; Multi-Modal Fusion; Multi-Hypergraph Neural Networks;
D O I
10.1109/ICME.2019.00111
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Emotion recognition from physiological signals is an effective way to discern the inner state of users. Existing works are lack in the exploration of latent correlation among multiple physiological signals and relationship among different subjects. To tackle this issue, we propose to recognize emotion from physiological signals using multi-hypergraph neural networks (MHGNN). In this method, the correlation among different subjects is formulated in the multi-hypergraph structure, where each type of physiological signal is used to generate one hypergraph. In each hypergraph, the hyperedges are used to represent the connections among the vertices (subject,stimuli). Thus, the emotion recognition task is modeled as classifying each vertex in the multi-hypergraph. Experimental results and comparisons with the state-of-the-art methods in the DEAP dataset demonstrate the superior performance of our method. The comparative experiments based on available biological knowledge verify that MHGNN can depict the real biological response process in a much more precise way.
引用
收藏
页码:610 / 615
页数:6
相关论文
共 50 条
  • [31] Hypergraph Neural Network for Emotion Recognition in Conversations
    Zheng, Cheng
    Xu, Haojie
    Sun, Xiao
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2024, 23 (02)
  • [32] Emotion Recognition in Conversations Using Brain and Physiological Signals
    Saffaryazdi, Nastaran
    Goonesekera, Yenushka
    Saffaryazdi, Nafiseh
    Hailemariam, Nebiyou Daniel
    Temesgen, Ebasa Girma
    Nanayakkara, Suranga
    Broadbent, Elizabeth
    Billinghurst, Mark
    IUI'22: 27TH INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2022, : 229 - 242
  • [33] Group Synchrony for Emotion Recognition Using Physiological Signals
    Bota, Patricia
    Zhang, Tianyi
    El Ali, Abdallah
    Fred, Ana
    da Silva, Hugo Placido
    Cesar, Pablo
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2023, 14 (04) : 2614 - 2625
  • [34] Emotion Recognition from Physiological Signals Based on ASAGA
    Zhou, Lianzhe
    Pang, Huanli
    Liu, Hanmei
    PROCEEDINGS OF THE 2012 INTERNATIONAL CONFERENCE ON COMMUNICATION, ELECTRONICS AND AUTOMATION ENGINEERING, 2013, 181 : 735 - 740
  • [35] Emotion Recognition from Physiological Channels Using Graph Neural Network
    Wiercinski, Tomasz
    Rock, Mateusz
    Zwierzycki, Robert
    Zawadzka, Teresa
    Zawadzki, Michal
    SENSORS, 2022, 22 (08)
  • [36] Emotion Recognition from Facial Expression Using Neural Networks
    Kharat, Govind U.
    Dudul, Sanjay V.
    2008 CONFERENCE ON HUMAN SYSTEM INTERACTIONS, VOLS 1 AND 2, 2008, : 428 - +
  • [37] Emotion recognition from physiological signals using wireless sensors for presence technologies
    Fatma Nasoz
    Kaye Alvarez
    Christine L. Lisetti
    Neal Finkelstein
    Cognition, Technology & Work, 2004, 6 (1) : 4 - 14
  • [38] Emotion Recognition from Physiological Signals using Fusion of Wavelet based Features
    Guendil, Zied
    Lachiri, Zied
    Maaoui, Choubeila
    Pruski, Alain
    2015 7TH INTERNATIONAL CONFERENCE ON MODELLING, IDENTIFICATION AND CONTROL (ICMIC), 2014, : 839 - 844
  • [39] Emotion Recognition from Facial Expression Using Neural Networks
    Kharat, G. U.
    Dudul, S. V.
    HUMAN-COMPUTER SYSTEMS INTERACTION: BACKGROUNDS AND APPLICATIONS, 2009, 60 : 207 - +
  • [40] Personalization of Emotion Recognition for Everyday Life Using Physiological Signals From Wearables
    Perz, Bartosz
    2022 10TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS, ACIIW, 2022,