Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] An Empirical Study of Emotion Recognition from Thermal Video Based on Deep Neural Networks
    Prawiro, Herman
    Pan, Tse-Yu
    Hu, Min-Chun
    2020 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP), 2020, : 407 - 410
  • [42] EMG-Based Cross-Subject Silent Speech Recognition Using Conditional Domain Adversarial Network
    Zhang, Yakun
    Cai, Huihui
    Wu, Jinghan
    Xie, Liang
    Xu, Minpeng
    Ming, Dong
    Yan, Ye
    Yin, Erwei
    IEEE TRANSACTIONS ON COGNITIVE AND DEVELOPMENTAL SYSTEMS, 2023, 15 (04) : 2282 - 2290
  • [43] Optimized Multi-Channel Deep Neural Network with 2D Graphical Representation of Acoustic Speech Features for Emotion Recognition
    Stolar, Melissa N.
    Lech, Margaret
    Burnett, Ian S.
    2014 8TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS), 2014,
  • [44] Personality-Based Emotion Recognition Using EEG Signals with a CNN-LSTM Network
    Hosseini, Mohammad Saleh Khajeh
    Firoozabadi, Seyed Mohammad
    Badie, Kambiz
    Azadfallah, Parviz
    BRAIN SCIENCES, 2023, 13 (06)
  • [45] EEG-Based Emotion Classification Using a Deep Neural Network and Sparse Autoencoder
    Liu, Junxiu
    Wu, Guopei
    Luo, Yuling
    Qiu, Senhui
    Yang, Su
    Li, Wei
    Bi, Yifei
    FRONTIERS IN SYSTEMS NEUROSCIENCE, 2020, 14
  • [46] Effectiveness of Deep Neural Network Model in Typing-based Emotion Detection on Smartphones
    Ghosh, Surjya
    Ganguly, Niloy
    Mitra, Bivas
    De, Pradipta
    MOBICOM'18: PROCEEDINGS OF THE 24TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, 2018, : 750 - 752
  • [47] FACIAL EXPRESSION BASED EMOTION RECOGNITION EMPLOYING YOLOV3 DEEP NEURAL NETWORKS
    Luh, Guan-Chun
    Wu, Hung-Bin
    Yong, Va-Ting
    Lai, Vu-Jhio
    Chen, Vu-Han
    PROCEEDINGS OF 2019 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS (ICMLC), 2019, : 451 - 457
  • [48] A Random Forest Weights and 4-Dimensional Convolutional Recurrent Neural Network for EEG Based Emotion Recognition
    Wang, Wenxu
    Yang, Jia
    Li, Shengjia
    Wang, Bin
    Yang, Kun
    Sang, Shengbo
    Zhang, Qiang
    Liu, Boyuan
    IEEE ACCESS, 2024, 12 : 39549 - 39563
  • [49] Joint low-rank tensor fusion and cross-modal attention for multimodal physiological signals based emotion recognition
    Wan, Xin
    Wang, Yongxiong
    Wang, Zhe
    Tang, Yiheng
    Liu, Benke
    PHYSIOLOGICAL MEASUREMENT, 2024, 45 (07)
  • [50] DNNAttention: A deep neural network and attention based architecture for cross project defect number prediction
    Pandey, Sushant Kumar
    Tripathi, Anil Kumar
    KNOWLEDGE-BASED SYSTEMS, 2021, 233