AN EMOTION ANALYSIS METHOD THAT INTEGRATES EEG SIGNALS AND MUSIC THERAPY USING A TRANSFORMER MODEL

被引:0
|
作者
Han, Jiayu [1 ]
Xu, Lijun [2 ]
Yang, Qing [3 ]
机构
[1] Nanjing Univ Arts, Coll Mus, Nanjing 211167, Jiangsu, Peoples R China
[2] Nanjing Inst Technol, Inst Art & Design, Nanjing 211167, Jiangsu, Peoples R China
[3] Nanjing Inst Technol, Inst Comp Engn, Nanjing 211167, Jiangsu, Peoples R China
关键词
EEG; sentiment analysis; transformer model; self-attention mechanism; music therapy;
D O I
10.1142/S0219519424400396
中图分类号
Q6 [生物物理学];
学科分类号
071011 ;
摘要
The need for sentiment analysis in the mental health field is increasing, and electroencephalogram (EEG) signals and music therapy have attracted extensive attention from researchers as breakthrough ideas. However, the existing methods still face the challenge of integrating temporal and spatial features when combining these two types, especially when considering the volume conduction differences among multichannel EEG signals and the different response speeds of subjects; moreover, the precision and accuracy of emotion analysis have yet to be improved. To solve this problem, we integrate the idea of top-k selection into the classic transformer model and construct a novel top-k sparse transformer model. This model captures emotion-related information in a finer way by selecting k data segments from an EEG signal with distinct signal features. However, this optimization process is not without its challenges, and we need to balance the selected k values to ensure that the important features are preserved while avoiding excessive information loss. Experiments conducted on the DEAP dataset demonstrate that our approach achieves significant improvements over other models. By enhancing the sensitivity of the model to the emotion-related information contained in EEG signals, our method achieves an overall emotion classification accuracy improvement and obtains satisfactory results when classifying different emotion dimensions. This study fills a research gap in the field of sentiment analysis involving EEG signals and music therapy, provides a novel and effective method, and is expected to lead to new ideas regarding the application of deep learning in sentiment analysis.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] A review: Music-emotion recognition and analysis based on EEG signals
    Cui, Xu
    Wu, Yongrong
    Wu, Jipeng
    You, Zhiyu
    Xiahou, Jianbing
    Ouyang, Menglin
    FRONTIERS IN NEUROINFORMATICS, 2022, 16
  • [2] Quantitative Analysis for Emotion Recognition by Using EEG Signals
    Khairunizam, Wan
    Lai, Y. J.
    Choong, W. Y.
    Mustapha, Wan Azani
    2024 16TH INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING, ICCAE 2024, 2024, : 428 - 431
  • [3] Continuous emotion recognition during music listening using EEG signals: A fuzzy parallel cascades model
    Hasanzadeh, Fatemeh
    Annabestani, Mohsen
    Moghimi, Sahar
    APPLIED SOFT COMPUTING, 2021, 101
  • [4] Multiscale Fractal Analysis on EEG Signals for Music-Induced Emotion Recognition
    Avramidis, Kleanthis
    Zlatintsi, Athanasia
    Garoufis, Christos
    Maragos, Petros
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1316 - 1320
  • [5] Emotion Classification Using EEG Signals
    Dabas, Harsh
    Sethi, Chaitanya
    Dua, Chirag
    Dalawat, Mohit
    Sethia, Divyashikha
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 380 - 384
  • [6] Emotion Recognition by Analysis of EEG Signals
    Blaiech, Hayfa
    Neji, Mohamed
    Wali, Ali
    Alimi, Adel M.
    2013 13TH INTERNATIONAL CONFERENCE ON HYBRID INTELLIGENT SYSTEMS (HIS), 2013, : 312 - 318
  • [7] Emotion recognition from EEG signals using machine learning model
    Akshay, K. R.
    Sundar, Sumod
    Shanir, Muhammed P. P.
    2022 5TH INTERNATIONAL CONFERENCE ON MULTIMEDIA, SIGNAL PROCESSING AND COMMUNICATION TECHNOLOGIES (IMPACT), 2022,
  • [8] A CONSUMER SENTIMENT ANALYSIS METHOD BASED ON EEG SIGNALS AND A RESNEXT MODEL
    Shen, Xiaoying
    Yuan, Chao
    JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2024, 24 (02)
  • [9] Interpretable Emotion Recognition Using EEG Signals
    Qing, Chunmei
    Qiao, Rui
    Xu, Xiangmin
    Cheng, Yongqiang
    IEEE ACCESS, 2019, 7 : 94160 - 94170
  • [10] An Ensemble Model for Consumer Emotion Prediction Using EEG Signals for Neuromarketing Applications
    Shah, Syed Mohsin Ali
    Usman, Syed Muhammad
    Khalid, Shehzad
    Rehman, Ikram Ur
    Anwar, Aamir
    Hussain, Saddam
    Ullah, Syed Sajid
    Elmannai, Hela
    Algarni, Abeer D.
    Manzoor, Waleed
    SENSORS, 2022, 22 (24)