Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Cross-Subject Cognitive Workload Recognition Based on EEG and Deep Domain Adaptation
    Zhou, Yueying
    Wang, Pengpai
    Gong, Peiliang
    Wei, Fulin
    Wen, Xuyun
    Wu, Xia
    Zhang, Daoqiang
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [32] Multimodal Emotion Recognition and State Analysis of Classroom Video and Audio Based on Deep Neural Network
    Li, Mingyong
    Liu, Mingyue
    Jiang, Zheng
    Zhao, Zongwei
    Zhang, Jiayan
    Ge, Mingyuan
    Duan, Huiming
    Wang, Yanxia
    JOURNAL OF INTERCONNECTION NETWORKS, 2022, 22 (SUPP04)
  • [33] Enhancement of Hybrid Deep Neural Network Using Activation Function for EEG Based Emotion Recognition
    Matthew, Jehosheba Margaret
    Mustafa, Masoodhu Banu Noordheen Mohammad
    TRAITEMENT DU SIGNAL, 2024, 41 (04) : 1991 - 2002
  • [34] A class alignment network based on self-attention for cross-subject EEG classification
    Ma, Sufan
    Zhang, Dongxiao
    Wang, Jiayi
    Xie, Jialiang
    BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2025, 11 (01):
  • [35] Emotion Recognition Using Hybrid Gaussian Mixture Model and Deep Neural Network
    Shahin, Ismail
    Nassif, Ali Bou
    Hamsa, Shibani
    IEEE ACCESS, 2019, 7 : 26777 - 26787
  • [36] Subject-Independent Emotion Detection from EEG Signals Using Deep Neural Network
    Pandey, Pallavi
    Seeja, K. R.
    INTERNATIONAL CONFERENCE ON INNOVATIVE COMPUTING AND COMMUNICATIONS, VOL 2, 2019, 56 : 41 - 46
  • [37] A customizable framework for multimodal emotion recognition using ensemble of deep neural network models
    Chhavi Dixit
    Shashank Mouli Satapathy
    Multimedia Systems, 2023, 29 : 3151 - 3168
  • [38] A customizable framework for multimodal emotion recognition using ensemble of deep neural network models
    Dixit, Chhavi
    Satapathy, Shashank Mouli
    MULTIMEDIA SYSTEMS, 2023, 29 (06) : 3151 - 3168
  • [39] A Systematic Exploration of Deep Neural Networks for EDA-Based Emotion Recognition
    Yu, Dian
    Sun, Shouqian
    INFORMATION, 2020, 11 (04)
  • [40] Deep neural network-based emotion recognition using facial landmark features and particle swarm optimization
    Vaijayanthi, S.
    Arunnehru, J.
    AUTOMATIKA, 2024, 65 (03) : 1088 - 1099