A study of emotion recognition methods incorporating functional brain network features and self-attention mechanisms

被引:0
|
作者
Zhang, Ye [1 ]
Li, Qi [1 ,2 ]
Liu, Yulong [1 ,2 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, 7089 Weixing Rd, Changchun, Jilin, Peoples R China
[2] Changchun Univ Sci & Technol, Zhongshan Res Inst, Zhongshan, Guangdong, Peoples R China
关键词
Feature fusion; Self-attentive mechanism; functional brain network; Median centrality; Clustering coefficient; Sentiment classification;
D O I
10.1145/3665689.3665749
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Aiming at the problem that a single feature is insufficient to characterize the emotional information in the emotion classification of EEG data, while the fusion of multiple features will lead to information redundancy, an emotion classification method that fuses brain functional network features and self-attention mechanism is proposed. The method introduces the median centrality feature (BC) and clustering coefficient feature (CC) to enhance the spatial information representation of brain regions; and uses the self-attention mechanism to establish a feature fusion model, through which the hidden relationship within the feature sequence is increased, which not only highlights the information coupling between the channels but also weakens the interfering information; and then uses the SVM classifier to classify the feature vectors for emotion classification, which is validated in the DEAP dataset. Validation. The experimental results show that the accuracy of the multi-feature fusion method in sentiment classification through self-attention reaches 85.13%. Compared with previous feature fusion methods, this method has better classification effect, proving its effectiveness and feasibility.
引用
收藏
页码:360 / 364
页数:5
相关论文
共 50 条
  • [31] Hybrid Network Using Dynamic Graph Convolution and Temporal Self-Attention for EEG-Based Emotion Recognition
    Dalian University of Technology, Department of Computer Science and Technology, Dalian
    116024, China
    不详
    313000, China
    IEEE Trans. Neural Networks Learn. Sys., 2162, 12 (18565-18575):
  • [32] Multi-Region and Multi-Band Electroencephalogram Emotion Recognition Based on Self-Attention and Capsule Network
    Ke, Sheng
    Ma, Chaoran
    Li, Wenjie
    Lv, Jidong
    Zou, Ling
    Prati, Andrea
    APPLIED SCIENCES-BASEL, 2024, 14 (02):
  • [33] Hybrid Network Using Dynamic Graph Convolution and Temporal Self-Attention for EEG-Based Emotion Recognition
    Cheng, Cheng
    Yu, Zikang
    Zhang, Yong
    Feng, Lin
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, : 1 - 11
  • [34] CSAT-FTCN: A Fuzzy-Oriented Model with Contextual Self-attention Network for Multimodal Emotion Recognition
    Jiang, Dazhi
    Liu, Hao
    Wei, Runguo
    Tu, Geng
    COGNITIVE COMPUTATION, 2023, 15 (03) : 1082 - 1091
  • [35] CSAT-FTCN: A Fuzzy-Oriented Model with Contextual Self-attention Network for Multimodal Emotion Recognition
    Dazhi Jiang
    Hao Liu
    Runguo Wei
    Geng Tu
    Cognitive Computation, 2023, 15 : 1082 - 1091
  • [36] A Static Sign Language Recognition Method Enhanced with Self-Attention Mechanisms
    Wang, Yongxin
    Jiang, He
    Sun, Yutong
    Xu, Longqi
    SENSORS, 2024, 24 (21)
  • [37] SELF-ATTENTION BASED DARKNET NAMED ENTITY RECOGNITION WITH BERT METHODS
    Chen, Yuxuan
    Guo, Yubin
    Jiang, Hong
    Ding, Jianwei
    Chen, Zhouguo
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2021, 17 (06): : 1973 - 1988
  • [38] Study on multidimensional emotion recognition fusing dynamic brain network features in EEG
    Wu, Yan
    Meng, Tianyu
    Li, Qi
    Xi, Yang
    Zhang, Hang
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 100
  • [39] A framework for facial expression recognition using deep self-attention network
    Indolia S.
    Nigam S.
    Singh R.
    Journal of Ambient Intelligence and Humanized Computing, 2023, 14 (07) : 9543 - 9562
  • [40] An efficient self-attention network for skeleton-based action recognition
    Xiaofei Qin
    Rui Cai
    Jiabin Yu
    Changxiang He
    Xuedian Zhang
    Scientific Reports, 12 (1)