AN EMOTION ANALYSIS METHOD THAT INTEGRATES EEG SIGNALS AND MUSIC THERAPY USING A TRANSFORMER MODEL

被引:0
作者
Han, Jiayu [1 ]
Xu, Lijun [2 ]
Yang, Qing [3 ]
机构
[1] Nanjing Univ Arts, Coll Mus, Nanjing 211167, Jiangsu, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Jiangsu, Peoples R China
[3] Nanjing Inst Technol, Inst Comp Engn, Nanjing 211167, Jiangsu, Peoples R China
关键词
EEG; sentiment analysis; transformer model; self-attention mechanism; music therapy;
D O I
10.1142/S0219519424400396
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The need for sentiment analysis in the mental health field is increasing, and electroencephalogram (EEG) signals and music therapy have attracted extensive attention from researchers as breakthrough ideas. However, the existing methods still face the challenge of integrating temporal and spatial features when combining these two types, especially when considering the volume conduction differences among multichannel EEG signals and the different response speeds of subjects; moreover, the precision and accuracy of emotion analysis have yet to be improved. To solve this problem, we integrate the idea of top-k selection into the classic transformer model and construct a novel top-k sparse transformer model. This model captures emotion-related information in a finer way by selecting k data segments from an EEG signal with distinct signal features. However, this optimization process is not without its challenges, and we need to balance the selected k values to ensure that the important features are preserved while avoiding excessive information loss. Experiments conducted on the DEAP dataset demonstrate that our approach achieves significant improvements over other models. By enhancing the sensitivity of the model to the emotion-related information contained in EEG signals, our method achieves an overall emotion classification accuracy improvement and obtains satisfactory results when classifying different emotion dimensions. This study fills a research gap in the field of sentiment analysis involving EEG signals and music therapy, provides a novel and effective method, and is expected to lead to new ideas regarding the application of deep learning in sentiment analysis.
引用
收藏
页数:15
相关论文
共 50 条
[31]   Emotion Recognition from Electroencephalogram (EEG) Signals Using a Multiple Column Convolutional Neural Network Model [J].
Jha S.K. ;
Suvvari S. ;
Kumar M. .
SN Computer Science, 5 (2)
[32]   MULTIPLE FEATURE FUSION FOR AUTOMATIC EMOTION RECOGNITION USING EEG SIGNALS [J].
Liu, Ningjie ;
Fang, Yuchun ;
Li, Ling ;
Hou, Limin ;
Yang, Fenglei ;
Guo, Yike .
2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, :896-900
[33]   Emotion recognition in EEG signals using deep learning methods: A review [J].
Jafari, Mahboobeh ;
Shoeibi, Afshin ;
Khodatars, Marjane ;
Bagherzadeh, Sara ;
Shalbaf, Ahmad ;
Garcia, David Lopez ;
Gorriz, Juan M. ;
Acharya, U. Rajendra .
COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 165
[34]   Emotion Assessment Using EEG Brain Signals and Stacked Sparse Autoencoder [J].
Issas, Sali ;
Peng, Qinmu ;
You, Xinge ;
Shah, Wahab Ali .
JOURNAL OF INFORMATION ASSURANCE AND SECURITY, 2019, 14 (01) :20-29
[35]   Dual temporal pathway model of emotion processing based on dynamic network reconfiguration analysis of EEG signals [J].
He, Yan ;
Liang, Yuan ;
Tong, Ling ;
Cui, Yujie ;
Yan, Hao .
ACTA PSYCHOLOGICA, 2025, 255
[36]   ReGA Based Feature Selection Emotion Recognition Using EEG Signals [J].
Kong, Yonghui ;
Yan, Jianzhou ;
Xu, Hongxia .
2017 CHINESE AUTOMATION CONGRESS (CAC), 2017, :6588-6593
[37]   Driver Vigilance Detection from EEG Signals using Transformer Networks [J].
Gao, Dingcheng ;
Du, Bing ;
Tao, Xiaoming ;
Lu, Jianhua .
2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, :1411-1416
[38]   Emotion Recognition Classification in EEG Signals Using Multivariate Synchrosqueezing Transform [J].
Ozel, Pinar ;
Akan, Aydin ;
Yilmaz, Bulent .
2017 MEDICAL TECHNOLOGIES NATIONAL CONGRESS (TIPTEKNO), 2017,
[39]   Time-Frequency Analysis of EEG Signals for Human Emotion Detection [J].
Murugappan, M. ;
Rizon, M. ;
Nagarajan, R. ;
Yaacob, S. ;
Hazry, D. ;
Zunaidi, I. .
4TH KUALA LUMPUR INTERNATIONAL CONFERENCE ON BIOMEDICAL ENGINEERING 2008, VOLS 1 AND 2, 2008, 21 (1-2) :262-+
[40]   Cognitive Analysis of EEG Signals Induced by Visual Stimulation of Facial Emotion [J].
Chen, Chen ;
Fang, Yuchun .
BIOMETRIC RECOGNITION (CCBR 2021), 2021, 12878 :120-127