Occluded Gait Emotion Recognition Based on Multi-Scale Suppression Graph Convolutional Network

被引:0
|
作者
Zou, Yuxiang [1 ]
He, Ning [2 ]
Sun, Jiwu [1 ]
Huang, Xunrui [1 ]
Wang, Wenhua [1 ]
机构
[1] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing 100101, Peoples R China
[2] Beijing Union Univ, Coll Smart City, Beijing 100101, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2025年 / 82卷 / 01期
基金
中国国家自然科学基金;
关键词
KNN interpolation; multi-scale temporal convolution; suppression graph convolutional network; gait emotion; recognition; human skeleton; PERCEPTION;
D O I
10.32604/cmc.2024.055732
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, gait-based emotion recognition has been widely applied in the field of computer vision. However, existing gait emotion recognition methods typically rely on complete human skeleton data, and their accuracy significantly declines when the data is occluded. To enhance the accuracy of gait emotion recognition under occlusion, this paper proposes a Multi-scale Suppression Graph Convolutional Network (MS-GCN). The MS-GCN Network (MS-TCN), and Suppression Graph Convolutional Network (SGCN). The JI Module completes the spatially occluded skeletal joints using the (K-Nearest Neighbors) KNN interpolation method. The MS-TCN employs convolutional kernels of various sizes to comprehensively capture the emotional information embedded in the gait, compensating for the temporal occlusion of gait information. The SGCN extracts more non-prominent human gait features by suppressing the extraction of key body part features, thereby reducing the negative impact of occlusion on emotion recognition results. The proposed method is evaluated on two comprehensive datasets: Emotion-Gait, containing 4227 real gaits from sources like BML, ICT-Pollick, and ELMD, and 1000 synthetic gaits generated using STEP-Gen technology, and ELMB, consisting of 3924 gaits, with 1835 labeled with emotions such as "Happy," "Sad," "Angry," and "Neutral." On the standard datasets Emotion-Gait and ELMB, the proposed method achieved accuracies of 0.900 and 0.896, respectively, attaining performance comparable to other state-ofthe-art methods. Furthermore, on occlusion datasets, the proposed method significantly mitigates the performance degradation caused by occlusion compared to other methods, the accuracy is significantly higher than that of other methods.
引用
收藏
页码:1255 / 1276
页数:22
相关论文
共 50 条
  • [41] Road Recognition Based on Multi-scale Convolutional Network with Multi-level Feature Fusion
    Li, Ye
    Guo, Lili
    Xu, Lele
    Wang, Xianfeng
    Jin, Shan
    TENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2018), 2019, 11069
  • [42] Anisotropic Multi-Scale Graph Convolutional Network for Dense Shape Correspondence
    Farazi, Mohammad
    Zhu, Wenhui
    Yang, Zhangsihao
    Wang, Yalin
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2023, : 3145 - 3154
  • [43] Multi-scale Graph Convolutional Network for understanding human action in videos
    Wang, Houlin
    Zhang, Shihui
    Tian, Qing
    Wang, Lei
    Luo, Bingchun
    Han, Xueqiang
    ADVANCED ENGINEERING INFORMATICS, 2025, 65
  • [44] GAITGRAPH: GRAPH CONVOLUTIONAL NETWORK FOR SKELETON-BASED GAIT RECOGNITION
    Teepe, Torben
    Khan, Ali
    Gilg, Johannes
    Herzog, Fabian
    Hoermann, Stefan
    Rigoll, Gerhard
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2314 - 2318
  • [45] Multi-Scale Convolutional Neural Network for Temporal Knowledge Graph Completion
    Liu, Wei
    Wang, Peijie
    Zhang, Zhihui
    Liu, Qiong
    COGNITIVE COMPUTATION, 2023, 15 (03) : 1016 - 1022
  • [46] MULTI-SCALE GRAPH CONVOLUTIONAL INTERACTION NETWORK FOR SALIENT OBJECT DETECTION
    Che, Wenqi
    Sun, Luoyi
    Xie, Zhifeng
    Ding, Youdong
    Han, Kaili
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 679 - 683
  • [47] Multi-scale attention graph convolutional recurrent network for traffic forecasting
    Xiong, Liyan
    Hu, Zhuyi
    Yuan, Xinhua
    Ding, Weihua
    Huang, Xiaohui
    Lan, Yuanchun
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (03): : 3277 - 3291
  • [48] Multi-Scale Convolutional Neural Network for Temporal Knowledge Graph Completion
    Wei Liu
    Peijie Wang
    Zhihui Zhang
    Qiong Liu
    Cognitive Computation, 2023, 15 : 1016 - 1022
  • [49] Multi-scale spatio-temporal network for skeleton-based gait recognition
    He, Dongzhi
    Xue, Yongle
    Li, Yunyu
    Sun, Zhijie
    Xiao, Xingmei
    Wang, Jin
    AI COMMUNICATIONS, 2023, 36 (04) : 297 - 310
  • [50] Multi-scale sampling attention graph convolutional networks for skeleton-based action recognition
    Tian, Haoyu
    Zhang, Yipeng
    Wu, Hanbo
    Ma, Xin
    Li, Yibin
    NEUROCOMPUTING, 2024, 597