MSFR-GCN: A Multi-Scale Feature Reconstruction Graph Convolutional Network for EEG Emotion and Cognition Recognition

被引:23
作者
Pan, Deng [1 ]
Zheng, Haohao [1 ]
Xu, Feifan [1 ]
Ouyang, Yu [1 ]
Jia, Zhe [1 ]
Wang, Chu [2 ]
Zeng, Hong [1 ]
机构
[1] Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Peoples R China
[2] Zhejiang Chinese Med Univ, Sch Clin Med 2, Hangzhou, Peoples R China
基金
美国国家科学基金会;
关键词
EEG emotion recognition; EEG cognition recognition; graph convolutional network; SE attention; graph pool;
D O I
10.1109/TNSRE.2023.3304660
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Graph Convolutional Network (GCN) excels at EEG recognition by capturing brain connections, but previous studies neglect the important EEG feature itself. In this study, we propose MSFR-GCN, a multi-scale feature reconstruction GCN for recognizing emotion and cognition tasks. Specifically, MSFR-GCN includes the MSFR and feature-pool characteristically, with the MSFR consisting of two sub-modules, multi-scale Squeeze-and-Excitation (MSSE) and multi-scale sample re-weighting (MSSR). MSSE assigns weights to channels and frequency bands based on their separate statistical information, while MSSR assigns sample weights based on combined channel and frequency information. The feature-pool, which pools across the feature dimension, is applied after GCN to retain EEG channel information. The MSFR-GCN achieves excellent results in emotion recognition when first tested on two public datasets, SEED and SEED-IV. Than the MSFR-GCN is tested on our self-collected Emotion and Cognition EEG dataset (ECED) for both emotion and cognition classification tasks. The results show MSFR-GCN's good performance in emotion and cognition classification tasks and reveal the implicit relationship between the two, which may provide aid in the rehabilitation of people with cognitive impairments from an emotional perspective.
引用
收藏
页码:3245 / 3254
页数:10
相关论文
共 45 条
[1]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[2]   Neural correlates of social and nonsocial emotions: An fMRI study [J].
Britton, Jennifer C. ;
Phan, K. Luan ;
Taylor, Stephan F. ;
Welsh, Robert C. ;
Berridge, Kent C. ;
Liberzon, I. .
NEUROIMAGE, 2006, 31 (01) :397-409
[3]   Montreal Cognitive Assessment for the diagnosis of Alzheimer's disease and other dementias [J].
Davis, Daniel H. J. ;
Creavin, Sam T. ;
Yip, Jennifer L. Y. ;
Noel-Storr, Anna H. ;
Brayne, Carol ;
Cullum, Sarah .
COCHRANE DATABASE OF SYSTEMATIC REVIEWS, 2015, (10)
[4]  
Defferrard M, 2016, ADV NEUR IN, V29
[5]   Emotion, cognition, and behavior [J].
Dolan, RJ .
SCIENCE, 2002, 298 (5596) :1191-1194
[6]   Neural correlates of emotion-cognition interactions: A review of evidence from brain imaging investigations [J].
Dolcos, Florin ;
Iordan, Alexandru D. ;
Dolcos, Sanda .
JOURNAL OF COGNITIVE PSYCHOLOGY, 2011, 23 (06) :669-694
[7]  
Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
[8]   Emotion regulation by cognitive reappraisal - The role of frontal theta oscillations [J].
Ertl, Matthias ;
Hildebrandt, Maria ;
Ourina, Kristina ;
Leicht, Gregor ;
Mulert, Christoph .
NEUROIMAGE, 2013, 81 :412-421
[9]  
Gilmer Justin, 2017, P MACHINE LEARNING R, V70
[10]   BRAIN AGEING The cognitive neuroscience of ageing [J].
Grady, Cheryl .
NATURE REVIEWS NEUROSCIENCE, 2012, 13 (07) :491-505