Effective Emotion Recognition by Learning Discriminative Graph Topologies in EEG Brain Networks

被引:40
作者
Li, Cunbo [1 ,2 ]
Li, Peiyang [3 ]
Zhang, Yangsong [4 ]
Li, Ning [1 ,2 ]
Si, Yajing [5 ]
Li, Fali [1 ,2 ]
Cao, Zehong [6 ]
Chen, Huafu [2 ,7 ]
Chen, Badong [8 ]
Yao, Dezhong [1 ,2 ,9 ]
Xu, Peng [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Clin Hosp, Chengdu Brain Sci Inst, Minist Educ,MOE Key Lab Neuroinformat, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 611731, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Bioinfomat, Chongqing 400065, Peoples R China
[4] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[5] Xinxiang Med Univ, Dept Psychol, Xinxiang 453003, Peoples R China
[6] Univ South Australia, Sci Technol Engn & Math STEM, Adelaide, SA 5000, Australia
[7] Army Med Univ, Affiliated Hosp 1, Dept Radiol, Chongqing 400038, Peoples R China
[8] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Peoples R China
[9] Chinese Acad Med Sci, Res Unit NeuroInformat, Chengdu 611731, Peoples R China
关键词
Emotion recognition; Brain modeling; Electroencephalography; Feature extraction; Network topology; Topology; Monitoring; Brain neural network; emotion recognition; emotional intelligence; graph topology; multiple emotion-related spatial network topology pattern (MESNP); COMPUTER INTERFACES; CHALLENGES; CONNECTIVITY; OSCILLATIONS; SELECTION;
D O I
10.1109/TNNLS.2023.3238519
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multichannel electroencephalogram (EEG) is an array signal that represents brain neural networks and can be applied to characterize information propagation patterns for different emotional states. To reveal these inherent spatial graph features and increase the stability of emotion recognition, we propose an effective emotion recognition model that performs multicategory emotion recognition with multiple emotion-related spatial network topology patterns (MESNPs) by learning discriminative graph topologies in EEG brain networks. To evaluate the performance of our proposed MESNP model, we conducted single-subject and multisubject four-class classification experiments on two public datasets, MAHNOB-HCI and DEAP. Compared with existing feature extraction methods, the MESNP model significantly enhances the multiclass emotional classification performance in the single-subject and multisubject conditions. To evaluate the online version of the proposed MESNP model, we designed an online emotion monitoring system. We recruited 14 participants to conduct the online emotion decoding experiments. The average online experimental accuracy of the 14 participants was 84.56%, indicating that our model can be applied in affective brain-computer interface (aBCI) systems. The offline and online experimental results demonstrate that the proposed MESNP model effectively captures discriminative graph topology patterns and significantly improves emotion classification performance. Moreover, the proposed MESNP model provides a new scheme for extracting features from strongly coupled array signals.
引用
收藏
页码:10258 / 10272
页数:15
相关论文
共 69 条
  • [1] Fusing highly dimensional energy and connectivity features to identify affective states from EEG signals
    Arnau-Gonzalez, Pablo
    Arevalillo-Herraez, Miguel
    Ramzan, Naeem
    [J]. NEUROCOMPUTING, 2017, 244 : 81 - 89
  • [2] Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers
    Atkinson, John
    Campos, Daniel
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2016, 47 : 35 - 41
  • [3] A note on the phase locking value and its properties
    Aydore, Sergul
    Pantazis, Dimitrios
    Leahy, Richard M.
    [J]. NEUROIMAGE, 2013, 74 : 231 - 244
  • [4] Recognition of emotional states using frequency effective connectivity maps through transfer learning approach from electroencephalogram signals
    Bagherzadeh, Sara
    Maghooli, Keivan
    Shalbaf, Ahmad
    Maghsoudi, Arash
    [J]. BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 75
  • [5] Emotion recognition using effective connectivity and pre-trained convolutional neural networks in EEG signals
    Bagherzadeh, Sara
    Maghooli, Keivan
    Shalbaf, Ahmad
    Maghsoudi, Arash
    [J]. COGNITIVE NEURODYNAMICS, 2022, 16 (05) : 1087 - 1106
  • [6] Optimizing spatial filters for robust EEG single-trial analysis
    Blankertz, Benjamin
    Tomioka, Ryota
    Lemm, Steven
    Kawanabe, Motoaki
    Mueller, Klaus-Robert
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2008, 25 (01) : 41 - 56
  • [7] The non-invasive Berlin Brain-Computer Interface:: Fast acquisition of effective performance in untrained subjects
    Blankertz, Benjamin
    Dornhege, Guido
    Krauledat, Matthias
    Mueller, Klaus-Robert
    Curio, Gabriel
    [J]. NEUROIMAGE, 2007, 37 (02) : 539 - 550
  • [8] Synaptic Plasticity, Engrams, and Network Oscillations in Amygdala Circuits for Storage and Retrieval of Emotional Memories
    Bocchio, Marco
    Nabavi, Sadegh
    Capogna, Marco
    [J]. NEURON, 2017, 94 (04) : 731 - 743
  • [9] Complex brain networks: graph theoretical analysis of structural and functional systems
    Bullmore, Edward T.
    Sporns, Olaf
    [J]. NATURE REVIEWS NEUROSCIENCE, 2009, 10 (03) : 186 - 198
  • [10] Emotion Assessment From Physiological Signals for Adaptation of Game Difficulty
    Chanel, Guillaume
    Rebetez, Cyril
    Betrancourt, Mireille
    Pun, Thierry
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2011, 41 (06): : 1052 - 1063