GaitSTAR: Spatial-Temporal Attention-Based Feature-Reweighting Architecture for Human Gait Recognition

被引:2
作者
Bilal, Muhammad [1 ]
He, Jianbiao [1 ]
Mushtaq, Husnain [1 ]
Asim, Muhammad [2 ]
Ali, Gauhar [2 ]
ElAffendi, Mohammed [2 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
[2] Prince Sultan Univ, Coll Comp & Informat Sci, EIAS Data Sci Lab, Riyadh 11586, Saudi Arabia
关键词
computer vision; human gait recognition; feature aggregation; feature set transformation; feature fusion; dynamic feature reweighting; deep learning;
D O I
10.3390/math12162458
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Human gait recognition (HGR) leverages unique gait patterns to identify individuals, but the effectiveness of this technique can be hindered due to various factors such as carrying conditions, foot shadows, clothing variations, and changes in viewing angles. Traditional silhouette-based systems often neglect the critical role of instantaneous gait motion, which is essential for distinguishing individuals with similar features. We introduce the "Enhanced Gait Feature Extraction Framework (GaitSTAR)", a novel method that incorporates dynamic feature weighting through the discriminant analysis of temporal and spatial features within a channel-wise architecture. Key innovations in GaitSTAR include dynamic stride flow representation (DSFR) to address silhouette distortion, a transformer-based feature set transformation (FST) for integrating image-level features into set-level features, and dynamic feature reweighting (DFR) for capturing long-range interactions. DFR enhances contextual understanding and improves detection accuracy by computing attention distributions across channel dimensions. Empirical evaluations show that GaitSTAR achieves impressive accuracies of 98.5%, 98.0%, and 92.7% under NM, BG, and CL conditions, respectively, with the CASIA-B dataset; 67.3% with the CASIA-C dataset; and 54.21% with the Gait3D dataset. Despite its complexity, GaitSTAR demonstrates a favorable balance between accuracy and computational efficiency, making it a powerful tool for biometric identification based on gait patterns.
引用
收藏
页数:23
相关论文
共 57 条
[1]   A multilevel paradigm for deep convolutional neural network features selection with an application to human gait recognition [J].
Arshad, Habiba ;
Khan, Muhammad Attique ;
Sharif, Muhammad Irfan ;
Yasmin, Mussarat ;
Tavares, Joao Manuel R. S. ;
Zhang, Yu-Dong ;
Satapathy, Suresh Chandra .
EXPERT SYSTEMS, 2022, 39 (07)
[2]   Real-Time Efficient FPGA Implementation of the Multi-Scale Lucas-Kanade and Horn-Schunck Optical Flow Algorithms for a 4K Video Stream [J].
Blachut, Krzysztof ;
Kryjak, Tomasz .
SENSORS, 2022, 22 (13)
[3]   An approach based on performer-attention-guided few-shot learning model for plant disease classification [J].
Boulila, Wadii .
EARTH SCIENCE INFORMATICS, 2024, 17 (04) :3797-3809
[4]   A transformer-based approach empowered by a self-attention technique for semantic segmentation in remote sensing [J].
Boulila, Wadii ;
Ghandorh, Hamza ;
Masood, Sharjeel ;
Alzahem, Ayyub ;
Koubaa, Anis ;
Ahmed, Fawad ;
Khan, Zahid ;
Ahmad, Jawad .
HELIYON, 2024, 10 (08)
[5]  
Chao HQ, 2019, AAAI CONF ARTIF INTE, P8126
[6]   Multi-view learning with distinguishable feature fusion for rumor detection [J].
Chen, Xueqin ;
Zhou, Fan ;
Trajcevski, Goce ;
Bonsangue, Marcello .
KNOWLEDGE-BASED SYSTEMS, 2022, 240
[7]   Adversarial learning-based skeleton synthesis with spatial-channel attention for robust gait recognition [J].
Chen, Ying ;
Xia, Shixiong ;
Zhao, Jiaqi ;
Zhou, Yong ;
Niu, Qiang ;
Yao, Rui ;
Zhu, Dongjun ;
Chen, Hao .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (01) :1489-1504
[8]   GaitPart: Temporal Part-based Model for Gait Recognition [J].
Fan, Chao ;
Peng, Yunjie ;
Cao, Chunshui ;
Liu, Xu ;
Hou, Saihui ;
Chi, Jiannan ;
Huang, Yongzhen ;
Li, Qing ;
He, Zhiqiang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :14213-14221
[9]   Two-frame motion estimation based on polynomial expansion [J].
Farnebäck, G .
IMAGE ANALYSIS, PROCEEDINGS, 2003, 2749 :363-370
[10]   Gait-D: Skeleton-based gait feature decomposition for gait recognition [J].
Gao, Shuo ;
Yun, Jing ;
Zhao, Yumeng ;
Liu, Limin .
IET COMPUTER VISION, 2022, 16 (02) :111-125