Personality first in emotion: a deep neural network based on electroencephalogram channel attention for cross-subject emotion recognition

被引:8
|
作者
Tian, Zhihang [1 ,2 ]
Huang, Dongmin [1 ,2 ]
Zhou, Sijin [1 ,2 ]
Zhao, Zhidan [1 ,2 ]
Jiang, Dazhi [1 ,2 ]
机构
[1] Shantou Univ, Sch Engn, Dept Comp Sci, Shantou 515063, Peoples R China
[2] Shantou Univ, Key Lab Intelligent Mfg Technol, Minist Educ, Shantou 515063, Peoples R China
来源
ROYAL SOCIETY OPEN SCIENCE | 2021年 / 8卷 / 08期
基金
中国国家自然科学基金;
关键词
cross subject; electroencephalogram emotion recognition; personality first; deep neural network; INDIVIDUAL-DIFFERENCES;
D O I
10.1098/rsos.201976
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In recent years, more and more researchers have focused on emotion recognition methods based on electroencephalogram (EEG) signals. However, most studies only consider the spatio-temporal characteristics of EEG and the modelling based on this feature, without considering personality factors, let alone studying the potential correlation between different subjects. Considering the particularity of emotions, different individuals may have different subjective responses to the same physical stimulus. Therefore, emotion recognition methods based on EEG signals should tend to be personalized. This paper models the personalized EEG emotion recognition from the macro and micro levels. At the macro level, we use personality characteristics to classify the individuals' personalities from the perspective of 'birds of a feather flock together'. At the micro level, we employ deep learning models to extract the spatio-temporal feature information of EEG. To evaluate the effectiveness of our method, we conduct an EEG emotion recognition experiment on the ASCERTAIN dataset. Our experimental results demonstrate that the recognition accuracy of our proposed method is 72.4% and 75.9% on valence and arousal, respectively, which is 10.2% and 9.1% higher than that of no consideration of personalization.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Coarse-to-Fine Domain Adaptation for Cross-Subject EEG Emotion Recognition with Contrastive Learning
    Ran, Shuang
    Zhong, Wei
    Hue, Fei
    Ye, Long
    Zhang, Qin
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XV, 2025, 15045 : 406 - 419
  • [22] Cross-subject EEG emotion recognition combined with connectivity features and meta-transfer learning
    Li, Jinyu
    Hua, Haoqiang
    Xu, Zhihui
    Shu, Lin
    Xu, Xiangmin
    Kuang, Feng
    Wu, Shibin
    COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 145
  • [23] RESEARCH ON INTELLIGENT RECOGNITION ALGORITHM OF FACE EMOTION BASED ON DEEP NEURAL NETWORK
    Yu, Zijia
    FRESENIUS ENVIRONMENTAL BULLETIN, 2021, 30 (2A): : 1995 - 2001
  • [24] Pre-trained Deep Convolution Neural Network Model With Attention for Speech Emotion Recognition
    Zhang, Hua
    Gou, Ruoyun
    Shang, Jili
    Shen, Fangyao
    Wu, Yifan
    Dai, Guojun
    FRONTIERS IN PHYSIOLOGY, 2021, 12
  • [25] Research on Speech Emotion Recognition Technology based on Deep and Shallow Neural Network
    Wang, Jian
    Han, Zhiyan
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 3555 - 3558
  • [26] A Study on Speech Emotion Recognition Using a Deep Neural Network
    Lee, Kyong Hee
    Choi, Hyun Kyun
    Jang, Byung Tae
    Kim, Do Hyun
    2019 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC): ICT CONVERGENCE LEADING THE AUTONOMOUS FUTURE, 2019, : 1162 - 1165
  • [27] Transfer Learning of Deep Neural Network for Speech Emotion Recognition
    Huang, Ying
    Hu, Mingqing
    Yu, Xianguo
    Wang, Tao
    Yang, Chen
    PATTERN RECOGNITION (CCPR 2016), PT II, 2016, 663 : 721 - 729
  • [28] Cross-subject EEG-based emotion recognition through dynamic optimization of random forest with sparrow search algorithm
    Zhang X.
    Wang S.
    Xu K.
    Zhao R.
    She Y.
    Mathematical Biosciences and Engineering, 2024, 21 (03) : 4779 - 4800
  • [29] Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features
    Lee, Ming-Che
    Yeh, Sheng-Cheng
    Chang, Jia-Wei
    Chen, Zhen-Yi
    SENSORS, 2022, 22 (13)
  • [30] Cross-subject EEG emotion classification based on few-label adversarial domain adaption
    Wang, Yingdong
    Liu, Jiatong
    Ruan, Qunsheng
    Wang, Shuocheng
    Wang, Chen
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 185