Occluded Gait Emotion Recognition Based on Multi-Scale Suppression Graph Convolutional Network

被引:0
|
作者
Zou, Yuxiang [1 ]
He, Ning [2 ]
Sun, Jiwu [1 ]
Huang, Xunrui [1 ]
Wang, Wenhua [1 ]
机构
[1] Beijing Union Univ, Beijing Key Lab Informat Serv Engn, Beijing 100101, Peoples R China
[2] Beijing Union Univ, Coll Smart City, Beijing 100101, Peoples R China
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2025年 / 82卷 / 01期
基金
中国国家自然科学基金;
关键词
KNN interpolation; multi-scale temporal convolution; suppression graph convolutional network; gait emotion; recognition; human skeleton; PERCEPTION;
D O I
10.32604/cmc.2024.055732
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, gait-based emotion recognition has been widely applied in the field of computer vision. However, existing gait emotion recognition methods typically rely on complete human skeleton data, and their accuracy significantly declines when the data is occluded. To enhance the accuracy of gait emotion recognition under occlusion, this paper proposes a Multi-scale Suppression Graph Convolutional Network (MS-GCN). The MS-GCN Network (MS-TCN), and Suppression Graph Convolutional Network (SGCN). The JI Module completes the spatially occluded skeletal joints using the (K-Nearest Neighbors) KNN interpolation method. The MS-TCN employs convolutional kernels of various sizes to comprehensively capture the emotional information embedded in the gait, compensating for the temporal occlusion of gait information. The SGCN extracts more non-prominent human gait features by suppressing the extraction of key body part features, thereby reducing the negative impact of occlusion on emotion recognition results. The proposed method is evaluated on two comprehensive datasets: Emotion-Gait, containing 4227 real gaits from sources like BML, ICT-Pollick, and ELMD, and 1000 synthetic gaits generated using STEP-Gen technology, and ELMB, consisting of 3924 gaits, with 1835 labeled with emotions such as "Happy," "Sad," "Angry," and "Neutral." On the standard datasets Emotion-Gait and ELMB, the proposed method achieved accuracies of 0.900 and 0.896, respectively, attaining performance comparable to other state-ofthe-art methods. Furthermore, on occlusion datasets, the proposed method significantly mitigates the performance degradation caused by occlusion compared to other methods, the accuracy is significantly higher than that of other methods.
引用
收藏
页码:1255 / 1276
页数:22
相关论文
共 50 条
  • [21] Dynamic graph convolutional network for assembly behavior recognition based on attention mechanism and multi-scale feature fusion
    Chengjun Chen
    Xicong Zhao
    Jinlei Wang
    Dongnian Li
    Yuanlin Guan
    Jun Hong
    Scientific Reports, 12
  • [22] Multi-task learning for gait-based identity recognition and emotion recognition using attention enhanced temporal graph convolutional network
    Sheng, Weijie
    Li, Xinde
    PATTERN RECOGNITION, 2021, 114
  • [23] Spatiotemporal Graph Convolutional Network for Multi-Scale Traffic Forecasting
    Wang, Yi
    Jing, Changfeng
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2022, 11 (02)
  • [24] Graph convolutional neural network for multi-scale feature learning
    Edwards, Michael
    Xie, Xianghua
    Palmer, Robert, I
    Tam, Gary K. L.
    Alcock, Rob
    Roobottom, Carl
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 194
  • [25] Multi-Scale Dynamic Convolutional Network for Knowledge Graph Embedding
    Zhang, Zhaoli
    Li, Zhifei
    Liu, Hai
    Xiong, Neal N.
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (05) : 2335 - 2347
  • [26] Structure-Aware Multi-scale Hierarchical Graph Convolutional Network for Skeleton Action Recognition
    He, Changxiang
    Liu, Shuting
    Zhao, Ying
    Qin, Xiaofei
    Zeng, Jiayuan
    Zhang, Xuedian
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2021, PT III, 2021, 12893 : 293 - 304
  • [27] Spatiotemporal smoothing aggregation enhanced multi-scale residual deep graph convolutional networks for skeleton-based gait recognition
    Chen, Guanghai
    Chen, Xin
    Zheng, Chengzhi
    Wang, Junshu
    Liu, Xinchao
    Han, Yuxing
    APPLIED INTELLIGENCE, 2024, 54 (08) : 6154 - 6174
  • [28] Pyr-HGCN: Pyramid Hybrid Graph Convolutional Network for Gait Emotion Recognition
    Jing, Li
    Yang, Guangchao
    Yin, Yunfei
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT V, 2024, 14429 : 187 - 198
  • [29] Ground Crack Recognition Based on Fully Convolutional Network With Multi-Scale Input
    Cheng, Jian
    Ye, Liang
    Guo, Yinan
    Zhang, Jun
    An, Hongbo
    IEEE ACCESS, 2020, 8 : 53034 - 53048
  • [30] Spatiotemporal multi-scale bilateral motion network for gait recognition
    Ding, Xinnan
    Du, Shan
    Zhang, Yu
    Wang, Kejun
    JOURNAL OF SUPERCOMPUTING, 2024, 80 (03): : 3412 - 3440