AN EMOTION ANALYSIS METHOD THAT INTEGRATES EEG SIGNALS AND MUSIC THERAPY USING A TRANSFORMER MODEL

被引:0
作者
Han, Jiayu [1 ]
Xu, Lijun [2 ]
Yang, Qing [3 ]
机构
[1] Nanjing Univ Arts, Coll Mus, Nanjing 211167, Jiangsu, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Jiangsu, Peoples R China
[3] Nanjing Inst Technol, Inst Comp Engn, Nanjing 211167, Jiangsu, Peoples R China
关键词
EEG; sentiment analysis; transformer model; self-attention mechanism; music therapy;
D O I
10.1142/S0219519424400396
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The need for sentiment analysis in the mental health field is increasing, and electroencephalogram (EEG) signals and music therapy have attracted extensive attention from researchers as breakthrough ideas. However, the existing methods still face the challenge of integrating temporal and spatial features when combining these two types, especially when considering the volume conduction differences among multichannel EEG signals and the different response speeds of subjects; moreover, the precision and accuracy of emotion analysis have yet to be improved. To solve this problem, we integrate the idea of top-k selection into the classic transformer model and construct a novel top-k sparse transformer model. This model captures emotion-related information in a finer way by selecting k data segments from an EEG signal with distinct signal features. However, this optimization process is not without its challenges, and we need to balance the selected k values to ensure that the important features are preserved while avoiding excessive information loss. Experiments conducted on the DEAP dataset demonstrate that our approach achieves significant improvements over other models. By enhancing the sensitivity of the model to the emotion-related information contained in EEG signals, our method achieves an overall emotion classification accuracy improvement and obtains satisfactory results when classifying different emotion dimensions. This study fills a research gap in the field of sentiment analysis involving EEG signals and music therapy, provides a novel and effective method, and is expected to lead to new ideas regarding the application of deep learning in sentiment analysis.
引用
收藏
页数:15
相关论文
共 50 条
[1]   A review: Music-emotion recognition and analysis based on EEG signals [J].
Cui, Xu ;
Wu, Yongrong ;
Wu, Jipeng ;
You, Zhiyu ;
Xiahou, Jianbing ;
Ouyang, Menglin .
FRONTIERS IN NEUROINFORMATICS, 2022, 16
[2]   Quantitative Analysis for Emotion Recognition by Using EEG Signals [J].
Khairunizam, Wan ;
Lai, Y. J. ;
Choong, W. Y. ;
Mustapha, Wan Azani .
2024 16TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING, ICCAE 2024, 2024, :428-431
[3]   Continuous emotion recognition during music listening using EEG signals: A fuzzy parallel cascades model [J].
Hasanzadeh, Fatemeh ;
Annabestani, Mohsen ;
Moghimi, Sahar .
APPLIED SOFT COMPUTING, 2021, 101
[4]   Multiscale Fractal Analysis on EEG Signals for Music-Induced Emotion Recognition [J].
Avramidis, Kleanthis ;
Zlatintsi, Athanasia ;
Garoufis, Christos ;
Maragos, Petros .
29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, :1316-1320
[5]   Emotion Classification Using EEG Signals [J].
Dabas, Harsh ;
Sethi, Chaitanya ;
Dua, Chirag ;
Dalawat, Mohit ;
Sethia, Divyashikha .
PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, :380-384
[6]   Emotion Recognition by Analysis of EEG Signals [J].
Blaiech, Hayfa ;
Neji, Mohamed ;
Wali, Ali ;
Alimi, Adel M. .
2013 13TH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS (HIS), 2013, :312-318
[7]   Emotion recognition from EEG signals using machine learning model [J].
Akshay, K. R. ;
Sundar, Sumod ;
Shanir, Muhammed P. P. .
2022 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA, SIGNAL PROCESSING AND COMMUNICATION TECHNOLOGIES (IMPACT), 2022,
[8]   A CONSUMER SENTIMENT ANALYSIS METHOD BASED ON EEG SIGNALS AND A RESNEXT MODEL [J].
Shen, Xiaoying ;
Yuan, Chao .
JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (02)
[9]   Interpretable Emotion Recognition Using EEG Signals [J].
Qing, Chunmei ;
Qiao, Rui ;
Xu, Xiangmin ;
Cheng, Yongqiang .
IEEE ACCESS, 2019, 7 :94160-94170
[10]   An Ensemble Model for Consumer Emotion Prediction Using EEG Signals for Neuromarketing Applications [J].
Shah, Syed Mohsin Ali ;
Usman, Syed Muhammad ;
Khalid, Shehzad ;
Rehman, Ikram Ur ;
Anwar, Aamir ;
Hussain, Saddam ;
Ullah, Syed Sajid ;
Elmannai, Hela ;
Algarni, Abeer D. ;
Manzoor, Waleed .
SENSORS, 2022, 22 (24)