A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition

被引:0
作者
Li, Rui [1 ]
Wang, Yiting [1 ]
Lu, Bao-Liang [1 ]
机构
[1] Shanghai Jiao Tong Univ, Shanghai, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021 | 2021年
基金
中国国家自然科学基金;
关键词
affective computing; EEG-based emotion recognition; adaptive; graph convolutional network; functional brain connectivity; FUNCTIONAL CONNECTIVITY;
D O I
10.114510.1145/3474085.3475697
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Among all solutions of emotion recognition tasks, electroencephalo-gram (EEG) is a very effective tool and has received broad attention from researchers. In addition, information across multimedia in EEG often provides a more complete picture of emotions. However, few of the existing studies concurrently incorporate EEG information from temporal domain, frequency domain and functional brain connectivity. In this paper, we propose a Multi-Domain Adaptive Graph Convolutional Network (MD-AGCN), fusing the knowledge of both the frequency domain and the temporal domain to fully utilize the complementary information of EEG signals. MDAGCN also considers the topology of EEG channels by combining the inter-channel correlations with the intra-channel information, from which the functional brain connectivity can be learned in an adaptive manner. Extensive experimental results demonstrate that our model exceeds state-of-the-art methods in most experimental settings. At the same time, the results show that MD-AGCN could extract complementary domain information and exploit channel relationships for EEG-based emotion recognition effectively.
引用
收藏
页码:5565 / 5573
页数:9
相关论文
共 37 条
[1]  
Bahari Fatemeh, 2013, 2013 20th Iranian Conference on Biomedical Engineering (ICBME). Proceedings, P228, DOI 10.1109/ICBME.2013.6782224
[2]   Depression and implicit emotion processing: An EEG study [J].
Bocharov, Andrey V. ;
Knyazev, Gennady G. ;
Savostyanov, Alexander N. .
NEUROPHYSIOLOGIE CLINIQUE-CLINICAL NEUROPHYSIOLOGY, 2017, 47 (03) :225-230
[3]  
Boski M, 2017, 2017 10TH INTERNATIONAL WORKSHOP ON MULTIDIMENSIONAL (ND) SYSTEMS (NDS)
[4]  
Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
[6]   MAGNETOENCEPHALOGRAPHY - THEORY, INSTRUMENTATION, AND APPLICATIONS TO NONINVASIVE STUDIES OF THE WORKING HUMAN BRAIN [J].
HAMALAINEN, M ;
HARI, R ;
ILMONIEMI, RJ ;
KNUUTILA, J ;
LOUNASMAA, OV .
REVIEWS OF MODERN PHYSICS, 1993, 65 (02) :413-497
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]   Emotion-Dependent Functional Connectivity of the Default Mode Network in Adolescent Depression [J].
Ho, Tiffany C. ;
Connolly, Colm G. ;
Blom, Eva Henje ;
LeWinn, Kaja Z. ;
Strigo, Irina A. ;
Paulus, Martin P. ;
Frank, Guido ;
Max, Jeffrey E. ;
Wu, Jing ;
Chan, Melanie ;
Tapert, Susan F. ;
Simmons, Alan N. ;
Yang, Tony T. .
BIOLOGICAL PSYCHIATRY, 2015, 78 (09) :635-646
[9]   Feature Extraction and Selection for Emotion Recognition from EEG [J].
Jenke, Robert ;
Peer, Angelika ;
Buss, Martin .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2014, 5 (03) :327-339
[10]   SST-EmotionNet: Spatial-Spectral-Temporal based Attention 3D Dense Network for EEG Emotion Recognition [J].
Jia, Ziyu ;
Lin, Youfang ;
Cai, Xiyang ;
Chen, Haobin ;
Gou, Haijun ;
Wang, Jing .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :2909-2917