AdaptiveGait: adaptive feature fusion network for gait recognition

被引:2
作者
Liang, Tian [1 ]
Chen, Zhenxue [1 ]
Liu, Chengyun [1 ]
Chen, Jiyang [2 ,3 ]
Hu, Yuchen [1 ]
Wu, Q. M. Jonathan [4 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Shandong Univ, Inst Marine Sci & Technol, Qingdao 266237, Peoples R China
[3] Shandong Zhengzhong Informat Technol Co Ltd, Jinan 250098, Peoples R China
[4] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
基金
中国国家自然科学基金;
关键词
CNN; Gait recognition; Adaptive feature fusion; Feature expansion; Cross-view;
D O I
10.1007/s11042-024-18692-0
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gait recognition is a biometric approach used to identify people based on their walking patterns at long distances and low resolutions. Most advanced gait recognition methods based on silhouettes employ the focal convolution module. However, experiments have demonstrated that the horizontal segmentation method used in this module causes information loss at the feature map demarcation line. In this paper, we propose an adaptive feature fusion block (AFFB) for feature extraction that utilizes comprehensive global features to compensate for the lost local features, significantly reducing feature loss caused by local convolution. Additionally, we introduce a feature expansion module (FEM) to enrich the temporal information of gait features and adaptively balance the body detail information extracted by the model with the overall body information . We evaluated our model on CASIA-B and OU-MVLP datasets and compared it to other gait models using RANK-1 accuracy. The experimental results show that our model can represent gait features better than other models and achieved high accuracy in gait recognition across perspectives and various walking conditions.The source code will be available on https://github.com/Lentia/AdaptiveGait.
引用
收藏
页码:83357 / 83376
页数:20
相关论文
共 32 条
  • [1] Lagrange Motion Analysis and View Embeddings for Improved Gait Recognition
    Chai, Tianrui
    Li, Annan
    Zhang, Shaoxiong
    Li, Zilong
    Wang, Yunhong
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 20217 - 20226
  • [2] Chao HQ, 2019, AAAI CONF ARTIF INTE, P8126
  • [3] Fan C, 2020, PROC CVPR IEEE, P14213, DOI 10.1109/CVPR42600.2020.01423
  • [4] NAS-FPN: Learning Scalable Feature Pyramid Architecture for Object Detection
    Ghiasi, Golnaz
    Lin, Tsung-Yi
    Le, Quoc V.
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 7029 - 7038
  • [5] Enhanced Spatial-Temporal Salience for Cross-View Gait Recognition
    Huang, Tianhuan
    Ben, Xianye
    Gong, Chen
    Zhang, Baochang
    Yan, Rui
    Wu, Qiang
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (10) : 6967 - 6980
  • [6] Adaptive feature fusion pyramid network for multi-classes agricultural pest detection
    Jiao, Lin
    Xie, Chengjun
    Chen, Peng
    Du, Jianming
    Li, Rui
    Zhang, Jie
    [J]. COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 195
  • [7] Adaptive feature fusion with attention mechanism for multi-scale target detection
    Ju, Moran
    Luo, Jiangning
    Wang, Zhongbo
    Luo, Haibo
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (07) : 2769 - 2781
  • [8] Kingma D. P., 2014, Adam: A method for stochastic optimization, DOI 10.48550/arXiv.1412.6980
  • [9] Adaptive Feature Fusion via Graph Neural Network for Person Re-identification
    Li, Yaoyu
    Yao, Hantao
    Duan, Lingyu
    Yao, Hanxing
    Xu, Changsheng
    [J]. PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 2115 - 2123
  • [10] A model-based gait recognition method with body pose and human prior knowledge
    Liao, Rijun
    Yu, Shiqi
    An, Weizhi
    Huang, Yongzhen
    [J]. PATTERN RECOGNITION, 2020, 98