AdaptiveGait: adaptive feature fusion network for gait recognition

被引:2
|
作者
Liang, Tian [1 ]
Chen, Zhenxue [1 ]
Liu, Chengyun [1 ]
Chen, Jiyang [2 ,3 ]
Hu, Yuchen [1 ]
Wu, Q. M. Jonathan [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Univ, Inst Marine Sci & Technol, Qingdao 266237, Peoples R China
[3] Shandong Zhengzhong Informat Technol Co Ltd, Jinan 250098, Peoples R China
[4] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
基金
中国国家自然科学基金;
关键词
CNN; Gait recognition; Adaptive feature fusion; Feature expansion; Cross-view;
D O I
10.1007/s11042-024-18692-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gait recognition is a biometric approach used to identify people based on their walking patterns at long distances and low resolutions. Most advanced gait recognition methods based on silhouettes employ the focal convolution module. However, experiments have demonstrated that the horizontal segmentation method used in this module causes information loss at the feature map demarcation line. In this paper, we propose an adaptive feature fusion block (AFFB) for feature extraction that utilizes comprehensive global features to compensate for the lost local features, significantly reducing feature loss caused by local convolution. Additionally, we introduce a feature expansion module (FEM) to enrich the temporal information of gait features and adaptively balance the body detail information extracted by the model with the overall body information . We evaluated our model on CASIA-B and OU-MVLP datasets and compared it to other gait models using RANK-1 accuracy. The experimental results show that our model can represent gait features better than other models and achieved high accuracy in gait recognition across perspectives and various walking conditions.The source code will be available on https://github.com/Lentia/AdaptiveGait.
引用
收藏
页码:83357 / 83376
页数:20
相关论文
共 50 条
  • [21] Occlusion-adaptive fusion for gait-based motion recognition
    Dockstader, SL
    FUSION 2003: PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE OF INFORMATION FUSION, VOLS 1 AND 2, 2003, : 283 - 290
  • [22] Domain Generalization for Activity Recognition via Adaptive Feature Fusion
    Qin, Xin
    Wang, Jindong
    Chen, Yiqiang
    Lu, Wang
    Jiang, Xinlong
    ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2023, 14 (01)
  • [23] Palmprint recognition based on gating mechanism and adaptive feature fusion
    Zhang, Kaibi
    Xu, Guofeng
    Jin, Ye Kelly
    Qi, Guanqiu
    Yang, Xun
    Bai, Litao
    FRONTIERS IN NEUROROBOTICS, 2023, 17
  • [24] On Reducing the Effect of Silhouette Quality on Individual Gait Recognition: a Feature Fusion Approach
    Jia, Ning
    Sanchez, Victor
    Li, Chang-Tsun
    Mansour, Hassan
    BIOSIG 2015 PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE OF THE BIOMETRICS SPECIAL INTEREST GROUP, 2015,
  • [25] Multimodal feature fusion for CNN-based gait recognition: an empirical comparison
    Francisco M. Castro
    Manuel J. Marín-Jiménez
    Nicolás Guil
    Nicolás Pérez de la Blanca
    Neural Computing and Applications, 2020, 32 : 14173 - 14193
  • [26] Multimodal feature fusion for CNN-based gait recognition: an empirical comparison
    Castro, Francisco M.
    Marin-Jimenez, Manuel J.
    Guil, Nicolas
    de la Blanca, Nicolas
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (17): : 14173 - 14193
  • [27] GaitMG: A Multi-grained Feature Aggregate Network for Gait Recognition
    Wan, Jiwei
    Zhao, Huimin
    Li, Rui
    Chen, Rongjun
    Wei, Tuanjie
    Ren, Yongqi
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2023, 2024, 14374 : 133 - 142
  • [28] A Machine Learning Method with Threshold Based Parallel Feature Fusion and Feature Selection for Automated Gait Recognition
    Sharif, Muhammad
    Attique, Muhammad
    Tahir, Muhammad Zeeshan
    Yasmim, Mussarat
    Saba, Tanzila
    Tanik, Urcun John
    JOURNAL OF ORGANIZATIONAL AND END USER COMPUTING, 2020, 32 (02) : 67 - 92
  • [29] Robust Gait Recognition Based on Spatio-Temporal Fusion Network
    Wang, Hongru
    Xu, Xinde
    NEURAL PROCESSING LETTERS, 2023, 55 (09) : 11785 - 11805
  • [30] Neural network ensemble with probabilistic fusion and its application to gait recognition
    Lee, Heesung
    Hong, SungJun
    Kim, Euntai
    NEUROCOMPUTING, 2009, 72 (7-9) : 1557 - 1564