A study of emotion recognition methods incorporating functional brain network features and self-attention mechanisms

被引:0
|
作者
Zhang, Ye [1 ]
Li, Qi [1 ,2 ]
Liu, Yulong [1 ,2 ]
机构
[1] Changchun Univ Sci & Technol, Sch Comp Sci & Technol, 7089 Weixing Rd, Changchun, Jilin, Peoples R China
[2] Changchun Univ Sci & Technol, Zhongshan Res Inst, Zhongshan, Guangdong, Peoples R China
关键词
Feature fusion; Self-attentive mechanism; functional brain network; Median centrality; Clustering coefficient; Sentiment classification;
D O I
10.1145/3665689.3665749
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Aiming at the problem that a single feature is insufficient to characterize the emotional information in the emotion classification of EEG data, while the fusion of multiple features will lead to information redundancy, an emotion classification method that fuses brain functional network features and self-attention mechanism is proposed. The method introduces the median centrality feature (BC) and clustering coefficient feature (CC) to enhance the spatial information representation of brain regions; and uses the self-attention mechanism to establish a feature fusion model, through which the hidden relationship within the feature sequence is increased, which not only highlights the information coupling between the channels but also weakens the interfering information; and then uses the SVM classifier to classify the feature vectors for emotion classification, which is validated in the DEAP dataset. Validation. The experimental results show that the accuracy of the multi-feature fusion method in sentiment classification through self-attention reaches 85.13%. Compared with previous feature fusion methods, this method has better classification effect, proving its effectiveness and feasibility.
引用
收藏
页码:360 / 364
页数:5
相关论文
共 50 条
  • [41] Dual-branch self-attention network for pedestrian attribute recognition
    Liu, Zhenyu
    Zhang, Zhang
    Li, Da
    Zhang, Peng
    Shan, Caifeng
    PATTERN RECOGNITION LETTERS, 2022, 163 : 112 - 120
  • [42] Self-Attention Network for Skeleton-based Human Action Recognition
    Cho, Sangwoo
    Maqbool, Muhammad Hasan
    Liu, Fei
    Foroosh, Hassan
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 624 - 633
  • [43] An efficient self-attention network for skeleton-based action recognition
    Qin, Xiaofei
    Cai, Rui
    Yu, Jiabin
    He, Changxiang
    Zhang, Xuedian
    SCIENTIFIC REPORTS, 2022, 12 (01):
  • [44] Ghost imaging object recognition based on self-attention mechanism network
    He, Yunting
    Yuan, Sheng
    Song, Jiali
    AIP ADVANCES, 2023, 13 (12)
  • [45] Regional Self-Attention Convolutional Neural Network for Facial Expression Recognition
    Zhou, Lifang
    Wang, Yi
    Lei, Bangjun
    Yang, Weibin
    INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2022, 36 (08)
  • [46] SPATIO-TEMPORAL SLOWFAST SELF-ATTENTION NETWORK FOR ACTION RECOGNITION
    Kim, Myeongjun
    Kim, Taehun
    Kim, Daijin
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2206 - 2210
  • [47] Age-Unbiased Facial Emotion Recognition with Regularizing Self-Attention Value Vector
    Park, Jaeil
    Cho, Sung-Bae
    INTELLIGENT DATA ENGINEERING AND AUTOMATED LEARNING - IDEAL 2024, PT I, 2025, 15346 : 472 - 480
  • [48] The Contrastive Network With Convolution and Self-Attention Mechanisms for Unsupervised Cell Segmentation
    Zhao, Yuhang
    Shao, Xianhao
    Chen, Cai
    Song, Junlin
    Tian, Chongxuan
    Li, Wei
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (12) : 5837 - 5847
  • [49] EEG-Based Emotion Recognition Using Convolutional Recurrent Neural Network with Multi-Head Self-Attention
    Hu, Zhangfang
    Chen, Libujie
    Luo, Yuan
    Zhou, Jingfan
    APPLIED SCIENCES-BASEL, 2022, 12 (21):
  • [50] Lightweight attention mechanisms for EEG emotion recognition for brain computer interface
    Gunda, Naresh Kumar
    Khalaf, Mohammed I.
    Bhatnagar, Shaleen
    Quraishi, Aadam
    Gudala, Leeladhar
    Venkata, Ashok Kumar Pamidi
    Alghayadh, Faisal Yousef
    Alsubai, Shtwai
    Bhatnagar, Vaibhav
    JOURNAL OF NEUROSCIENCE METHODS, 2024, 410