Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] Cross-Subject Emotion Recognition Using Deep Adaptation Networks
    Li, He
    Jin, Yi-Ming
    Zheng, Wei-Long
    Lu, Bao-Liang
    NEURAL INFORMATION PROCESSING (ICONIP 2018), PT V, 2018, 11305 : 403 - 413
  • [2] Cross-Subject EEG-Based Emotion Recognition with Deep Domain Confusion
    Zhang, Weiwei
    Wang, Fei
    Jiang, Yang
    Xu, Zongfeng
    Wu, Shichao
    Zhang, Yahui
    INTELLIGENT ROBOTICS AND APPLICATIONS, ICIRA 2019, PT I, 2019, 11740 : 558 - 570
  • [3] Cross-Subject EEG Emotion Recognition With Self-Organized Graph Neural Network
    Li, Jingcong
    Li, Shuqi
    Pan, Jiahui
    Wang, Fei
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [4] Temporal aware Mixed Attention-based Convolution and Transformer Network for cross-subject EEG emotion recognition
    Si, Xiaopeng
    Huang, Dong
    Liang, Zhen
    Sun, Yulin
    Huang, He
    Liu, Qile
    Yang, Zhuobin
    Ming, Dong
    Computers in Biology and Medicine, 2024, 181
  • [5] Comprehensive Multisource Learning Network for Cross-Subject Multimodal Emotion Recognition
    Chen, Chuangquan
    Li, Zhencheng
    Kou, Kit Ian
    Du, Jie
    Li, Chen
    Wang, Hongtao
    Vong, Chi-Man
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 365 - 380
  • [6] Cross-Subject emotion recognition from EEG using Convolutional Neural Networks
    Zhong, Xiaolong
    Yin, Zhong
    Zhang, Jianhua
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7516 - 7521
  • [7] Cross-Subject EEG-Based Emotion Recognition Through Neural Networks With Stratified Normalization
    Fdez, Javier
    Guttenberg, Nicholas
    Witkowski, Olaf
    Pasquali, Antoine
    FRONTIERS IN NEUROSCIENCE, 2021, 15
  • [8] VAE-CapsNet: A common emotion information extractor for cross-subject emotion recognition
    Chen, Huayu
    Li, Junxiang
    He, Huanhuan
    Sun, Shuting
    Zhu, Jing
    Li, Xiaowei
    Hu, Bin
    KNOWLEDGE-BASED SYSTEMS, 2025, 311
  • [9] Interpretable Cross-Subject EEG-Based Emotion Recognition Using Channel-Wise Features†
    Jin, Longbin
    Kim, Eun Yi
    SENSORS, 2020, 20 (23) : 1 - 18
  • [10] Cross-subject emotion EEG signal recognition based on source microstate analysis
    Zhang, Lei
    Xiao, Di
    Guo, Xiaojing
    Li, Fan
    Liang, Wen
    Zhou, Bangyan
    FRONTIERS IN NEUROSCIENCE, 2023, 17