AN EMOTION ANALYSIS METHOD THAT INTEGRATES EEG SIGNALS AND MUSIC THERAPY USING A TRANSFORMER MODEL

被引:0
作者
Han, Jiayu [1 ]
Xu, Lijun [2 ]
Yang, Qing [3 ]
机构
[1] Nanjing Univ Arts, Coll Mus, Nanjing 211167, Jiangsu, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Jiangsu, Peoples R China
[3] Nanjing Inst Technol, Inst Comp Engn, Nanjing 211167, Jiangsu, Peoples R China
关键词
EEG; sentiment analysis; transformer model; self-attention mechanism; music therapy;
D O I
10.1142/S0219519424400396
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The need for sentiment analysis in the mental health field is increasing, and electroencephalogram (EEG) signals and music therapy have attracted extensive attention from researchers as breakthrough ideas. However, the existing methods still face the challenge of integrating temporal and spatial features when combining these two types, especially when considering the volume conduction differences among multichannel EEG signals and the different response speeds of subjects; moreover, the precision and accuracy of emotion analysis have yet to be improved. To solve this problem, we integrate the idea of top-k selection into the classic transformer model and construct a novel top-k sparse transformer model. This model captures emotion-related information in a finer way by selecting k data segments from an EEG signal with distinct signal features. However, this optimization process is not without its challenges, and we need to balance the selected k values to ensure that the important features are preserved while avoiding excessive information loss. Experiments conducted on the DEAP dataset demonstrate that our approach achieves significant improvements over other models. By enhancing the sensitivity of the model to the emotion-related information contained in EEG signals, our method achieves an overall emotion classification accuracy improvement and obtains satisfactory results when classifying different emotion dimensions. This study fills a research gap in the field of sentiment analysis involving EEG signals and music therapy, provides a novel and effective method, and is expected to lead to new ideas regarding the application of deep learning in sentiment analysis.
引用
收藏
页数:15
相关论文
共 50 条
[21]   Deep feature extraction from EEG signals using xception model for emotion classification [J].
Phukan, Arpan ;
Gupta, Deepak .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (11) :33445-33463
[22]   Deep feature extraction from EEG signals using xception model for emotion classification [J].
Arpan Phukan ;
Deepak Gupta .
Multimedia Tools and Applications, 2024, 83 :33445-33463
[23]   Spatiotemporal Emotion Recognition Method Based on EEG Signals During Music Listening Using 1D-CNN & Stacked-LSTM [J].
Liao, Shengli ;
Zhang, Yumei ;
Yang, Honghong ;
Liao, Xuening .
2022 INTERNATIONAL CONFERENCE ON NETWORKING AND NETWORK APPLICATIONS, NANA, 2022, :7-12
[24]   A Modified Transformer Network for Seizure Detection Using EEG Signals [J].
Hu, Wenrong ;
Wang, Juan ;
Li, Feng ;
Ge, Daohui ;
Wang, Yuxia ;
Jia, Qingwei ;
Yuan, Shasha .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2025, 35 (02)
[25]   CONTINUOUS EMOTION DETECTION USING EEG SIGNALS AND FACIAL EXPRESSIONS [J].
Soleymani, Mohammad ;
Asghari-Esfeden, Sadjad ;
Pantic, Maja ;
Fu, Yun .
2014 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2014,
[26]   Analysis of EEG Signals and Facial Expressions for Continuous Emotion Detection [J].
Soleymani, Mohammad ;
Asghari-Esfeden, Sadjad ;
Fu, Yun ;
Pantic, Maja .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2016, 7 (01) :17-28
[27]   EEG Emotion Recognition Applied to the Effect Analysis of Music on Emotion Changes in Psychological Healthcare [J].
Zhou, Tie Hua ;
Liang, Wenlong ;
Liu, Hangyu ;
Wang, Ling ;
Ryu, Keun Ho ;
Nam, Kwang Woo .
INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH, 2023, 20 (01)
[28]   EEG-CNN-Souping: Interpretable emotion recognition from EEG signals using EEG-CNN-souping model and explainable AI [J].
Chaudary, Eamin ;
Khan, Sheeraz Ahmad ;
Mumtaz, Wajid .
COMPUTERS & ELECTRICAL ENGINEERING, 2025, 123
[29]   Analysis of Different Human Emotion with EEG signal Using Back Propagation Method [J].
Behera, Subhashree ;
Padhy, H. M. ;
Mani, Prashant .
2016 INTERNATIONAL CONFERENCE ON MICRO-ELECTRONICS AND TELECOMMUNICATION ENGINEERING (ICMETE), 2016, :314-319
[30]   Multifractal Detrended Fluctuation Analysis of the Music Induced EEG Signals [J].
Maity, Akash Kumar ;
Pratihar, Ruchira ;
Agrawal, Vishal ;
Mitra, Anubrato ;
Dey, Subham ;
Sanyal, Shankha ;
Banerjee, Archi ;
Sengupta, Ranjan ;
Ghosh, Dipak .
2015 INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND SIGNAL PROCESSING (ICCSP), 2015, :252-257