Occluded Gait Emotion Recognition Based on Multi-Scale Suppression Graph Convolutional Network

被引:0
|
作者
Zou, Yuxiang [1 ]
He, Ning [2 ]
Sun, Jiwu [1 ]
Huang, Xunrui [1 ]
Wang, Wenhua [1 ]
机构
[1] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing 100101, Peoples R China
[2] Beijing Union Univ, Coll Smart City, Beijing 100101, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2025年 / 82卷 / 01期
基金
中国国家自然科学基金;
关键词
KNN interpolation; multi-scale temporal convolution; suppression graph convolutional network; gait emotion; recognition; human skeleton; PERCEPTION;
D O I
10.32604/cmc.2024.055732
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, gait-based emotion recognition has been widely applied in the field of computer vision. However, existing gait emotion recognition methods typically rely on complete human skeleton data, and their accuracy significantly declines when the data is occluded. To enhance the accuracy of gait emotion recognition under occlusion, this paper proposes a Multi-scale Suppression Graph Convolutional Network (MS-GCN). The MS-GCN Network (MS-TCN), and Suppression Graph Convolutional Network (SGCN). The JI Module completes the spatially occluded skeletal joints using the (K-Nearest Neighbors) KNN interpolation method. The MS-TCN employs convolutional kernels of various sizes to comprehensively capture the emotional information embedded in the gait, compensating for the temporal occlusion of gait information. The SGCN extracts more non-prominent human gait features by suppressing the extraction of key body part features, thereby reducing the negative impact of occlusion on emotion recognition results. The proposed method is evaluated on two comprehensive datasets: Emotion-Gait, containing 4227 real gaits from sources like BML, ICT-Pollick, and ELMD, and 1000 synthetic gaits generated using STEP-Gen technology, and ELMB, consisting of 3924 gaits, with 1835 labeled with emotions such as "Happy," "Sad," "Angry," and "Neutral." On the standard datasets Emotion-Gait and ELMB, the proposed method achieved accuracies of 0.900 and 0.896, respectively, attaining performance comparable to other state-ofthe-art methods. Furthermore, on occlusion datasets, the proposed method significantly mitigates the performance degradation caused by occlusion compared to other methods, the accuracy is significantly higher than that of other methods.
引用
收藏
页码:1255 / 1276
页数:22
相关论文
共 50 条
  • [1] Emotion recognition using multi-scale EEG features through graph convolutional attention network
    Cao, Liwen
    Zhao, Wenfeng
    Sun, Biao
    NEURAL NETWORKS, 2025, 184
  • [2] Multi-Scale Sparse Graph Convolutional Network For the Assessment of Parkinsonian Gait
    Guo, Rui
    Shao, Xiangxin
    Zhang, Chencheng
    Qian, Xiaohua
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1583 - 1594
  • [3] Gait Emotion Recognition Based on a Multi-scale Partitioning Directed Spatio-temporal Graph
    Zhang J.
    Gao J.
    Huang Z.
    Xu G.
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (03): : 1069 - 1078
  • [4] EEG-Based Emotion Recognition by Convolutional Neural Network with Multi-Scale Kernels
    Phan, Tran-Dac-Thinh
    Kim, Soo-Hyung
    Yang, Hyung-Jeong
    Lee, Guee-Sang
    SENSORS, 2021, 21 (15)
  • [5] Multi-label image recognition based on adaptive multi-scale graph convolutional network
    Wang X.-S.
    Rong X.-L.
    Cheng Y.-H.
    Chen Z.-S.
    Kongzhi yu Juece/Control and Decision, 2022, 37 (07): : 1737 - 1744
  • [6] Human Action Recognition Based on Multi-Scale Feature Augmented Graph Convolutional Network
    Lv, Wangyang
    Zhou, Yinghua
    6TH INTERNATIONAL CONFERENCE ON INNOVATION IN ARTIFICIAL INTELLIGENCE, ICIAI2022, 2022, : 112 - 118
  • [7] Multi-Scale Structural Graph Convolutional Network for Skeleton-Based Action Recognition
    Jang, Sungjun
    Lee, Heansung
    Kim, Woo Jin
    Lee, Jungho
    Woo, Sungmin
    Lee, Sangyoun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (08) : 7244 - 7258
  • [8] Bridge Graph Attention Based Graph Convolution Network With Multi-Scale Transformer for EEG Emotion Recognition
    Yan, Huachao
    Guo, Kailing
    Xing, Xiaofen
    Xu, Xiangmin
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (04) : 2042 - 2054
  • [9] MSFR-GCN: A Multi-Scale Feature Reconstruction Graph Convolutional Network for EEG Emotion and Cognition Recognition
    Pan, Deng
    Zheng, Haohao
    Xu, Feifan
    Ouyang, Yu
    Jia, Zhe
    Wang, Chu
    Zeng, Hong
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 3245 - 3254
  • [10] Multi-scale Dilated Attention Graph Convolutional Network for Skeleton-Based Action Recognition
    Shu, Yang
    Li, Wanggen
    Li, Doudou
    Gao, Kun
    Jie, Biao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT I, 2024, 14425 : 16 - 28