Occluded Gait Emotion Recognition Based on Multi-Scale Suppression Graph Convolutional Network

被引:0
|
作者
Zou, Yuxiang [1 ]
He, Ning [2 ]
Sun, Jiwu [1 ]
Huang, Xunrui [1 ]
Wang, Wenhua [1 ]
机构
[1] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing 100101, Peoples R China
[2] Beijing Union Univ, Coll Smart City, Beijing 100101, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2025年 / 82卷 / 01期
基金
中国国家自然科学基金;
关键词
KNN interpolation; multi-scale temporal convolution; suppression graph convolutional network; gait emotion; recognition; human skeleton; PERCEPTION;
D O I
10.32604/cmc.2024.055732
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, gait-based emotion recognition has been widely applied in the field of computer vision. However, existing gait emotion recognition methods typically rely on complete human skeleton data, and their accuracy significantly declines when the data is occluded. To enhance the accuracy of gait emotion recognition under occlusion, this paper proposes a Multi-scale Suppression Graph Convolutional Network (MS-GCN). The MS-GCN Network (MS-TCN), and Suppression Graph Convolutional Network (SGCN). The JI Module completes the spatially occluded skeletal joints using the (K-Nearest Neighbors) KNN interpolation method. The MS-TCN employs convolutional kernels of various sizes to comprehensively capture the emotional information embedded in the gait, compensating for the temporal occlusion of gait information. The SGCN extracts more non-prominent human gait features by suppressing the extraction of key body part features, thereby reducing the negative impact of occlusion on emotion recognition results. The proposed method is evaluated on two comprehensive datasets: Emotion-Gait, containing 4227 real gaits from sources like BML, ICT-Pollick, and ELMD, and 1000 synthetic gaits generated using STEP-Gen technology, and ELMB, consisting of 3924 gaits, with 1835 labeled with emotions such as "Happy," "Sad," "Angry," and "Neutral." On the standard datasets Emotion-Gait and ELMB, the proposed method achieved accuracies of 0.900 and 0.896, respectively, attaining performance comparable to other state-ofthe-art methods. Furthermore, on occlusion datasets, the proposed method significantly mitigates the performance degradation caused by occlusion compared to other methods, the accuracy is significantly higher than that of other methods.
引用
收藏
页码:1255 / 1276
页数:22
相关论文
共 50 条
  • [31] Multi-Scale Receptive Field Graph Model for Emotion Recognition in Conversations
    Wei, Jie
    Hu, Guanyu
    Tuan, Luu Anh
    Yang, Xinyu
    Zhu, Wenjing
    ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, 2023, 2023-June
  • [32] Spatiotemporal multi-scale bilateral motion network for gait recognition
    Xinnan Ding
    Shan Du
    Yu Zhang
    Kejun Wang
    The Journal of Supercomputing, 2024, 80 : 3412 - 3440
  • [33] GM-TCNet: Gated Multi-scale Temporal Convolutional Network using Emotion Causality for Speech Emotion Recognition*
    Ye, Jia-Xin
    Wen, Xin-Cheng
    Wang, Xuan-Ze
    Xu, Yong
    Luo, Yan
    Wu, Chang-Li
    Chen, Li-Yan
    Liu, Kun-Hong
    SPEECH COMMUNICATION, 2022, 145 : 21 - 35
  • [34] Multi-scale occlusion suppression network for occluded person re-identification
    Zhang, Yunzuo
    Yang, Yuehui
    Kang, Weili
    Zhen, Jiawen
    PATTERN RECOGNITION LETTERS, 2024, 185 : 66 - 72
  • [35] Multi-Scale Receptive Fields Convolutional Network for Action Recognition
    Dong, Zhiang
    Xie, Miao
    Li, Xiaoqiang
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [36] Multi-Scale convolutional neural network for finger vein recognition
    Liu, Junbo
    Ma, Hui
    Guo, Zishuo
    INFRARED PHYSICS & TECHNOLOGY, 2024, 143
  • [37] Multi-scale convolutional attention network for radar behavior recognition
    Xiong J.
    Pan J.
    Bi D.
    Du M.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2023, 50 (06): : 62 - 74
  • [38] Saliency Driven Monocular Depth Estimation Based on Multi-scale Graph Convolutional Network
    Wu, Dunquan
    Chen, Chenglizhao
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT IX, 2024, 14433 : 445 - 456
  • [39] Multi-scale graph diffusion convolutional network for multi-view learning
    Wang, Shiping
    Li, Jiacheng
    Chen, Yuhong
    Wu, Zhihao
    Huang, Aiping
    Zhang, Le
    ARTIFICIAL INTELLIGENCE REVIEW, 2025, 58 (06)
  • [40] A Multi-Domain Adaptive Graph Convolutional Network for EEG-based Emotion Recognition
    Li, Rui
    Wang, Yiting
    Lu, Bao-Liang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5565 - 5573