A study of emotion recognition methods incorporating functional brain network features and self-attention mechanisms

被引:0
|
作者
Zhang, Ye [1 ]
Li, Qi [1 ,2 ]
Liu, Yulong [1 ,2 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, 7089 Weixing Rd, Changchun, Jilin, Peoples R China
[2] Changchun Univ Sci & Technol, Zhongshan Res Inst, Zhongshan, Guangdong, Peoples R China
关键词
Feature fusion; Self-attentive mechanism; functional brain network; Median centrality; Clustering coefficient; Sentiment classification;
D O I
10.1145/3665689.3665749
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Aiming at the problem that a single feature is insufficient to characterize the emotional information in the emotion classification of EEG data, while the fusion of multiple features will lead to information redundancy, an emotion classification method that fuses brain functional network features and self-attention mechanism is proposed. The method introduces the median centrality feature (BC) and clustering coefficient feature (CC) to enhance the spatial information representation of brain regions; and uses the self-attention mechanism to establish a feature fusion model, through which the hidden relationship within the feature sequence is increased, which not only highlights the information coupling between the channels but also weakens the interfering information; and then uses the SVM classifier to classify the feature vectors for emotion classification, which is validated in the DEAP dataset. Validation. The experimental results show that the accuracy of the multi-feature fusion method in sentiment classification through self-attention reaches 85.13%. Compared with previous feature fusion methods, this method has better classification effect, proving its effectiveness and feasibility.
引用
收藏
页码:360 / 364
页数:5
相关论文
共 50 条
  • [1] Self-attention for Speech Emotion Recognition
    Tarantino, Lorenzo
    Garner, Philip N.
    Lazaridis, Alexandros
    INTERSPEECH 2019, 2019, : 2578 - 2582
  • [2] MULTIMODAL CROSS- AND SELF-ATTENTION NETWORK FOR SPEECH EMOTION RECOGNITION
    Sun, Licai
    Liu, Bin
    Tao, Jianhua
    Lian, Zheng
    2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021), 2021, : 4275 - 4279
  • [3] CGLF-Net: Image Emotion Recognition Network by Combining Global Self-Attention Features and Local Multiscale Features
    Luo, Yutong
    Zhong, Xinyue
    Zeng, Minchen
    Xie, Jialan
    Wang, Shiyuan
    Liu, Guangyuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1894 - 1908
  • [4] Conversational Emotion Recognition Using Self-Attention Mechanisms and Graph Neural Networks
    Lian, Zheng
    Tao, Jianhua
    Liu, Bin
    Huang, Jian
    Yang, Zhanlei
    Li, Rongjun
    INTERSPEECH 2020, 2020, : 2347 - 2351
  • [5] Spatial-frequency convolutional self-attention network for EEG emotion recognition
    Li, Dongdong
    Xie, Li
    Chai, Bing
    Wang, Zhe
    Yang, Hai
    APPLIED SOFT COMPUTING, 2022, 122
  • [6] Attention to Emotions: Body Emotion Recognition In-the-Wild Using Self-attention Transformer Network
    Paiva, Pedro V. V.
    Ramos, Josue J. G.
    Gavrilova, Marina
    Carvalho, Marco A. G.
    COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VISIGRAPP 2023, 2024, 2103 : 206 - 228
  • [7] Self-attention transfer networks for speech emotion recognition
    Ziping ZHAO
    Keru Wang
    Zhongtian BAO
    Zixing ZHANG
    Nicholas CUMMINS
    Shihuang SUN
    Haishuai WANG
    Jianhua TAO
    Bj?rn W.SCHULLER
    虚拟现实与智能硬件(中英文), 2021, 3 (01) : 43 - 54
  • [8] Enhancing speech emotion recognition: a deep learning approach with self-attention and acoustic features
    Aghajani, Khadijeh
    Zohrevandi, Mahbanou
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (05):
  • [9] Speech Emotion Recognition Based on Self-Attention Weight Correction for Acoustic and Text Features
    Santoso, Jennifer
    Yamada, Takeshi
    Ishizuka, Kenkichi
    Hashimoto, Taiichi
    Makino, Shoji
    IEEE ACCESS, 2022, 10 : 115732 - 115743
  • [10] DILATED RESIDUAL NETWORK WITH MULTI-HEAD SELF-ATTENTION FOR SPEECH EMOTION RECOGNITION
    Li, Runnan
    Wu, Zhiyong
    Jia, Jia
    Zhao, Sheng
    Meng, Helen
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 6675 - 6679