Effective Emotion Recognition by Learning Discriminative Graph Topologies in EEG Brain Networks

被引:56
作者
Li, Cunbo [1 ,2 ]
Li, Peiyang [3 ]
Zhang, Yangsong [4 ]
Li, Ning [1 ,2 ]
Si, Yajing [5 ]
Li, Fali [1 ,2 ]
Cao, Zehong [6 ]
Chen, Huafu [2 ,7 ]
Chen, Badong [8 ]
Yao, Dezhong [1 ,2 ,9 ]
Xu, Peng [1 ,2 ]
机构
[1] Univ Elect Sci & Technol China, Clin Hosp, Chengdu Brain Sci Inst, Minist Educ,MOE Key Lab Neuroinformat, Chengdu 611731, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 611731, Peoples R China
[3] Chongqing Univ Posts & Telecommun, Sch Bioinfomat, Chongqing 400065, Peoples R China
[4] Southwest Univ Sci & Technol, Sch Comp Sci & Technol, Mianyang 621010, Peoples R China
[5] Xinxiang Med Univ, Dept Psychol, Xinxiang 453003, Peoples R China
[6] Univ South Australia, Sci Technol Engn & Math STEM, Adelaide, SA 5000, Australia
[7] Army Med Univ, Affiliated Hosp 1, Dept Radiol, Chongqing 400038, Peoples R China
[8] Xi An Jiao Tong Univ, Inst Artificial Intelligence & Robot, Xian 710049, Peoples R China
[9] Chinese Acad Med Sci, Res Unit NeuroInformat, Chengdu 611731, Peoples R China
关键词
Emotion recognition; Brain modeling; Electroencephalography; Feature extraction; Network topology; Topology; Monitoring; Brain neural network; emotion recognition; emotional intelligence; graph topology; multiple emotion-related spatial network topology pattern (MESNP); COMPUTER INTERFACES; CHALLENGES; CONNECTIVITY; OSCILLATIONS; SELECTION;
D O I
10.1109/TNNLS.2023.3238519
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Multichannel electroencephalogram (EEG) is an array signal that represents brain neural networks and can be applied to characterize information propagation patterns for different emotional states. To reveal these inherent spatial graph features and increase the stability of emotion recognition, we propose an effective emotion recognition model that performs multicategory emotion recognition with multiple emotion-related spatial network topology patterns (MESNPs) by learning discriminative graph topologies in EEG brain networks. To evaluate the performance of our proposed MESNP model, we conducted single-subject and multisubject four-class classification experiments on two public datasets, MAHNOB-HCI and DEAP. Compared with existing feature extraction methods, the MESNP model significantly enhances the multiclass emotional classification performance in the single-subject and multisubject conditions. To evaluate the online version of the proposed MESNP model, we designed an online emotion monitoring system. We recruited 14 participants to conduct the online emotion decoding experiments. The average online experimental accuracy of the 14 participants was 84.56%, indicating that our model can be applied in affective brain-computer interface (aBCI) systems. The offline and online experimental results demonstrate that the proposed MESNP model effectively captures discriminative graph topology patterns and significantly improves emotion classification performance. Moreover, the proposed MESNP model provides a new scheme for extracting features from strongly coupled array signals.
引用
收藏
页码:10258 / 10272
页数:15
相关论文
共 69 条
[31]   Classifying Different Emotional States by Means of EEG-Based Functional Connectivity Patterns [J].
Lee, You-Yun ;
Hsieh, Shulan .
PLOS ONE, 2014, 9 (04)
[32]   Tuning the developing brain to social signals of emotions [J].
Leppanen, Jukka M. ;
Nelson, Charles A. .
NATURE REVIEWS NEUROSCIENCE, 2009, 10 (01) :37-47
[33]   EEG Based Emotion Recognition by Combining Functional Connectivity Network and Local Activations [J].
Li, Peiyang ;
Liu, Huan ;
Si, Yajing ;
Li, Cunbo ;
Li, Fali ;
Zhu, Xuyang ;
Huang, Xiaoye ;
Zen, Ying ;
Yao, Dezhong ;
Zhang, Yangsong ;
Xu, Peng .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2019, 66 (10) :2869-2881
[34]   Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals [J].
Liu, Yong-Jin ;
Yu, Minjing ;
Zhao, Guozhen ;
Song, Jinjing ;
Ge, Yan ;
Shi, Yuanchun .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2018, 9 (04) :550-562
[35]   EEG-based affective state recognition from human brain signals by using Hjorth-activity [J].
Mehmood, Raja Majid ;
Bilal, Muhammad ;
Vimal, S. ;
Lee, Seong-Whan .
MEASUREMENT, 2022, 202
[36]   A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges [J].
Muehl, Christian ;
Allison, Brendan ;
Nijholt, Anton ;
Chanel, Guillaume .
BRAIN-COMPUTER INTERFACES, 2014, 1 (02) :66-84
[37]   Overlapping communities reveal rich structure in large-scale brain networks during rest and task conditions [J].
Najafi, Mahshid ;
McMenamin, Brenton W. ;
Simon, Jonathan Z. ;
Pessoa, Luiz .
NEUROIMAGE, 2016, 135 :92-106
[38]   Evolutionary computation algorithms for feature selection of EEG-based emotion recognition using mobile sensors [J].
Nakisa, Bahareh ;
Rastgoo, Mohammad Naim ;
Tjondronegoro, Dian ;
Chandran, Vinod .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 93 :143-155
[39]   Empirical Evidence Relating EEG Signal Duration to Emotion Classification Performance [J].
Pereira, Eanes Torres ;
Gomes, Herman Martins ;
Veloso, Luciana Ribeiro ;
Mota, Moises Araujo .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2021, 12 (01) :154-164
[40]   On the relationship between emotion and cognition [J].
Pessoa, Luiz .
NATURE REVIEWS NEUROSCIENCE, 2008, 9 (02) :148-158