Cross-Subject Channel Selection Using Modified Relief and Simplified CNN-Based Deep Learning for EEG-Based Emotion Recognition

被引:7
作者
Farokhah, Lia [1 ,2 ]
Sarno, Riyanarto [1 ]
Fatichah, Chastine [1 ]
机构
[1] Inst Teknol Sepuluh Nopember ITS, Fac Intelligent Elect & Informat Technol, Dept Informat, Surabaya, Indonesia
[2] Inst Teknol Bisnis ASIA Malang, Fac Technol & Design, Dept Informat, Malang 65142, Indonesia
基金
英国科研创新办公室;
关键词
Electroencephalography; Emotion recognition; Deep learning; Brain modeling; Collaboration; Computer architecture; Support vector machines; Convolutional neural networks; Channel selection; emotion recognition; validation; cross-subject; scalogram; CLASSIFICATION;
D O I
10.1109/ACCESS.2023.3322294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Emotion recognition based on EEG has been implemented in numerous studies. In most of them, there are two observations made: first, extensive implementation is negatively associated with the performed validation. Cross-subject validation is more difficult than subject-dependent validation due to the high variability between EEG recordings caused by domain shifts. Second, a large number of channels requires extensive computation. Efforts to reduce channels are impeded by decreased performance as the number of channels is decreased; therefore, an effective approach for reducing channels is required to maintain performance. In this paper, we propose collaboration on 2D EEG input in the form of scalograms, CNN, and channel selection based on power spectral density ratios coupled with the relief method. The power ratio is derived from the power band's power spectral density. Based on the trial selection with various conditions, the collaboration of the proposed scalogram and PR-Relief (power ratio-Relief) produced a stable classification rate. For analysis, the Database for Emotion Analysis of Physiological Signals (DEAP) has been employed. Experimental results indicate that the proposed method increases the accuracy of cross-subject emotion recognition using 10 channels by 2.71% for valence and 1.96% for arousal, respectively. Using 10 channels for subject-dependent validation, the efficacy of the valence and arousal classes increased by 2.41% and 1.2%, respectively. Consequently, by pursuing collaboration between input interpretation and stable channel selection methods, the proposed collaborative method achieves a better result.
引用
收藏
页码:110136 / 110150
页数:15
相关论文
共 50 条
[21]   Deep Learning Model With Adaptive Regularization for EEG-Based Emotion Recognition Using Temporal and Frequency Features [J].
Samavat, Alireza ;
Khalili, Ebrahim ;
Ayati, Bentolhoda ;
Ayati, Marzieh .
IEEE ACCESS, 2022, 10 :24520-24527
[22]   Cross-Subject Multimodal Emotion Recognition Based on Hybrid Fusion [J].
Cimtay, Yucel ;
Ekmekcioglu, Erhan ;
Caglar-Ozhan, Seyma .
IEEE ACCESS, 2020, 8 :168865-168878
[23]   Multi-Source Reinforced Selective Domain Adaptation for Cross-Subject and Cross-Session EEG-Based Emotion Recognition [J].
Deng, Xin ;
Hong, Xinyi ;
Ai, Lijiao ;
Li, Xingchen ;
Li, Chenhui .
IEEE ACCESS, 2025, 13 :94822-94833
[24]   Deep Learning for EEG-based Emotion Recognition: A Survey [J].
Li J.-Y. ;
Du X.-B. ;
Zhu Z.-L. ;
Deng X.-M. ;
Ma C.-X. ;
Wang H.-A. .
Ruan Jian Xue Bao/Journal of Software, 2023, 34 (01) :255-276
[25]   EEG-based Cross-subject Mental Fatigue Recognition [J].
Liu, Yisi ;
Lan, Zirui ;
Cui, Jian ;
Sourina, Olga ;
Muller-Wittig, Wolfgang .
2019 INTERNATIONAL CONFERENCE ON CYBERWORLDS (CW), 2019, :247-252
[26]   EEG-based emotion recognition using hybrid CNN and LSTM classification [J].
Chakravarthi, Bhuvaneshwari ;
Ng, Sin-Chun ;
Ezilarasan, M. R. ;
Leung, Man-Fai .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
[27]   EEG-Based Cross-Subject Driver Drowsiness Recognition With an Interpretable Convolutional Neural Network [J].
Cui, Jian ;
Lan, Zirui ;
Sourina, Olga ;
Muller-Wittig, Wolfgang .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) :7921-7933
[28]   Multimodal Deep Learning Model for Subject-Independent EEG-based Emotion Recognition [J].
Dharia, Shyamal Y. ;
Valderrama, Camilo E. ;
Camorlinga, Sergio G. .
2023 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING, CCECE, 2023,
[29]   From Intricacy to Conciseness: A Progressive Transfer Strategy for EEG-Based Cross-Subject Emotion Recognition [J].
Cai, Ziliang ;
Wang, Lingyue ;
Guo, Miaomiao ;
Xu, Guizhi ;
Guo, Lei ;
Li, Ying .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2022, 32 (03)
[30]   Toward cross-subject and cross-session generalization in EEG-based emotion recognition: Systematic review, taxonomy, and methods [J].
Apicella, Andrea ;
Arpaia, Pasquale ;
D'Errico, Giovanni ;
Marocco, Davide ;
Mastrati, Giovanna ;
Moccaldi, Nicola ;
Prevete, Roberto .
NEUROCOMPUTING, 2024, 604