AN EMOTION ANALYSIS METHOD THAT INTEGRATES EEG SIGNALS AND MUSIC THERAPY USING A TRANSFORMER MODEL

被引:0
作者
Han, Jiayu [1 ]
Xu, Lijun [2 ]
Yang, Qing [3 ]
机构
[1] Nanjing Univ Arts, Coll Mus, Nanjing 211167, Jiangsu, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Jiangsu, Peoples R China
[3] Nanjing Inst Technol, Inst Comp Engn, Nanjing 211167, Jiangsu, Peoples R China
关键词
EEG; sentiment analysis; transformer model; self-attention mechanism; music therapy;
D O I
10.1142/S0219519424400396
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The need for sentiment analysis in the mental health field is increasing, and electroencephalogram (EEG) signals and music therapy have attracted extensive attention from researchers as breakthrough ideas. However, the existing methods still face the challenge of integrating temporal and spatial features when combining these two types, especially when considering the volume conduction differences among multichannel EEG signals and the different response speeds of subjects; moreover, the precision and accuracy of emotion analysis have yet to be improved. To solve this problem, we integrate the idea of top-k selection into the classic transformer model and construct a novel top-k sparse transformer model. This model captures emotion-related information in a finer way by selecting k data segments from an EEG signal with distinct signal features. However, this optimization process is not without its challenges, and we need to balance the selected k values to ensure that the important features are preserved while avoiding excessive information loss. Experiments conducted on the DEAP dataset demonstrate that our approach achieves significant improvements over other models. By enhancing the sensitivity of the model to the emotion-related information contained in EEG signals, our method achieves an overall emotion classification accuracy improvement and obtains satisfactory results when classifying different emotion dimensions. This study fills a research gap in the field of sentiment analysis involving EEG signals and music therapy, provides a novel and effective method, and is expected to lead to new ideas regarding the application of deep learning in sentiment analysis.
引用
收藏
页数:15
相关论文
共 50 条
[41]   An art therapy evaluation method based on emotion recognition using EEG deep temporal features [J].
Zhichuan Tang ;
Xintao Li ;
Dan Xia ;
Yidan Hu ;
Lingtao Zhang ;
Jun Ding .
Multimedia Tools and Applications, 2022, 81 :7085-7101
[42]   An art therapy evaluation method based on emotion recognition using EEG deep temporal features [J].
Tang, Zhichuan ;
Li, Xintao ;
Xia, Dan ;
Hu, Yidan ;
Zhang, Lingtao ;
Ding, Jun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (05) :7085-7101
[43]   A Customized ECA-CRNN Model for Emotion Recognition Based on EEG Signals [J].
Song, Yan ;
Yin, Yiming ;
Xu, Panfeng .
ELECTRONICS, 2023, 12 (13)
[44]   A Multi-Column CNN Model for Emotion Recognition from EEG Signals [J].
Yang, Heekyung ;
Han, Jongdae ;
Min, Kyungha .
SENSORS, 2019, 19 (21)
[45]   Hybrid Classification Model for Emotion Prediction from EEG Signals: A Comparative Study [J].
Bardak, F. Kebire ;
Seyman, M. Nuri ;
Temurtas, Feyzullah .
JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2023, 29 (12) :1424-1438
[46]   Analysis of Indonesian Sentiment Text based on Affective Space Model (ASM) using Electroencephalogram (EEG) signals [J].
Hulliyah, Khodijah ;
Wahab, Abdul ;
Kamaruddin, Norhaslinda ;
Erdogan, Sevki ;
Durachman, Yusuf .
2016 INTERNATIONAL CONFERENCE ON INFORMATICS AND COMPUTING (ICIC), 2016, :325-328
[47]   Music emotion recognition based on temporal convolutional attention network using EEG [J].
Qiao, Yinghao ;
Mu, Jiajia ;
Xie, Jialan ;
Hu, Binghui ;
Liu, Guangyuan .
FRONTIERS IN HUMAN NEUROSCIENCE, 2024, 18
[48]   Classification of Emotion Primitives from EEG Signals Using Visual and Audio Stimuli [J].
Dasdemir, Yasar ;
Yildirim, Serdar ;
Yildirim, Esen .
2015 23RD SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2015, :2250-2253
[49]   Effects of feature reduction on emotion recognition using EEG signals and machine learning [J].
Trujillo, Leonardo ;
Hernandez, Daniel E. ;
Rodriguez, Adrian ;
Monroy, Omar ;
Villanueva, Omar .
EXPERT SYSTEMS, 2024, 41 (08)
[50]   Machine-Learning-Based Emotion Recognition System Using EEG Signals [J].
Alhalaseh, Rania ;
Alasasfeh, Suzan .
COMPUTERS, 2020, 9 (04) :1-15