Personal-Zscore: Eliminating Individual Difference for EEG-Based Cross-Subject Emotion Recognition

被引:29
作者
Chen, Huayu [1 ]
Sun, Shuting [1 ,2 ]
Li, Jianxiu [1 ]
Yu, Ruilan [1 ]
Li, Nan [1 ]
Li, Xiaowei [3 ]
Hu, Bin [1 ,4 ,5 ,6 ]
机构
[1] Lanzhou Univ, Sch Informat Sci & Engn, Gansu Prov Key Lab Wearable Comp, Lanzhou 730000, Peoples R China
[2] Beijing Inst Technol, Beijing 100811, Peoples R China
[3] Lanzhou Univ, Shandong Acad Intelligent Comp Technol, Sch Informat Sci & Engn, Gansu Prov Key Lab Wearable Comp, Lanzhou 730000, Peoples R China
[4] Shanghai Inst Biol Sci, CAS Ctr Excellence Brain Sci & Intelligence Techno, Shanghai 200234, Peoples R China
[5] Chinese Acad Sci, Joint Res Ctr Cognit Neurosensor Technol Lanzhou U, Beijing 100045, Peoples R China
[6] Lanzhou Univ, Engn Res Ctr Open Source Software & Real Time Syst, Minist Educ, Lanzhou 730000, Peoples R China
基金
中国国家自然科学基金;
关键词
EEG; individual difference; affective computing; emotion recognition; subject-dependent; subject-independent; ENTROPY FEATURE; CLASSIFICATION; BRAIN; REGRESSION; MACHINE;
D O I
10.1109/TAFFC.2021.3137857
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
It was observed that accuracy of the Subject-Dependent emotion recognition model was much higher than that of the Subject-Independent modela in the field of electroencephalogram (EEG) based affective computing. This phenomenon is mainly caused by the individual difference of EEG, which is the key issue to be solved for the application of emotion recognition. In this work, 14 subjects from the SEED were selected for individual difference analysis. Through individual aggregation features evaluation, sample space visualization, and correlation analysis, we proposed four quantification indicators to analyze individual difference phenomenon. Finally, we presented the Personal-Zscore (PZ) feature processing method, and it was found that the data set processed with PZ method could represent emotion better than the original data set, and the conventional model with the PZ method was more robust. The accuracies of emotion recognition models trained with PZ processing have been improved to some extent, which showed that the PZ method could effectively eliminate the individual aggregation of feature space and improve the emotional representation ability of data sets. Hence, our findings may provide a new insight into the foundation for universal implementation of EEG-based application, and the Personal-Zscore feature processing method is of great significance for the development of effective emotion recognition system.
引用
收藏
页码:2077 / 2088
页数:12
相关论文
共 66 条
[11]  
Duan RN, 2013, I IEEE EMBS C NEUR E, P81, DOI 10.1109/NER.2013.6695876
[12]  
Dunteman G.H., 1989, PRINCIPAL COMPONENTS, DOI [10.4135/9781412985475, DOI 10.4135/9781412985475]
[13]   Robust EEG-based cross-site and cross-protocol classification of states of consciousness [J].
Engemann, Denis A. ;
Raimondo, Federico ;
King, Jean-Remi ;
Rohaut, Benjamin ;
Louppe, Gilles ;
Faugeras, Frederic ;
Annen, Jitka ;
Cassol, Helena ;
Gosseries, Olivia ;
Fernandez-Slezak, Diego ;
Laureys, Steven ;
Naccache, Lionel ;
Dehaene, Stanislas ;
Sitt, Jacobo D. .
BRAIN, 2018, 141 :3179-3192
[14]   PHYSICAL SIGNIFICANCE OF TIME DOMAIN DESCRIPTORS IN EEG ANALYSIS [J].
HJORTH, B .
ELECTROENCEPHALOGRAPHY AND CLINICAL NEUROPHYSIOLOGY, 1973, 34 (03) :321-325
[15]   Emotion recognition using deep learning approach from audio-visual emotional big data [J].
Hossain, M. Shamim ;
Muhammad, Ghulam .
INFORMATION FUSION, 2019, 49 :69-78
[16]   Attention Recognition in EEG-Based Affective Learning Research Using CFS plus KNN Algorithm [J].
Hu, Bin ;
Li, Xiaowei ;
Sun, Shuting ;
Ratcliffe, Martyn .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2018, 15 (01) :38-45
[17]   Sleep staging algorithm based on multichannel data adding and multifeature screening [J].
Huang, Wu ;
Guo, Bing ;
Shen, Yan ;
Tang, Xiangdong ;
Zhang, Tao ;
Li, Dan ;
Jiang, Zhonghui .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2020, 187
[18]   Multi-modal emotion analysis from facial expressions and electroencephalogram [J].
Huang, Xiaohua ;
Kortelainen, Jukka ;
Zhao, Guoying ;
Li, Xiaobai ;
Moilanen, Antti ;
Seppanen, Tapio ;
Pietikainen, Matti .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2016, 147 :114-124
[19]   Transfer Learning in Brain-Computer Interfaces [J].
Jayaram, Vinay ;
Alamgir, Morteza ;
Altun, Yasemin ;
Schoelkopf, Bernhard ;
Grosse-Wentrup, Moritz .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2016, 11 (01) :20-31
[20]   Emotion recognition based on the sample entropy of EEG [J].
Jie, Xiang ;
Rui, Cao ;
Li, Li .
BIO-MEDICAL MATERIALS AND ENGINEERING, 2014, 24 (01) :1185-1192