An end-to-end gait recognition system for covariate conditions using custom kernel CNN

被引:2
作者
Ali, Babar [1 ]
Bukhari, Maryam [1 ]
Maqsood, Muazzam [1 ]
Moon, Jihoon [2 ]
Hwang, Eenjun [3 ]
Rho, Seungmin [4 ]
机构
[1] COMSATS Univ Islamabad, Dept Comp Sci, Attock Campus, Islamabad, Pakistan
[2] Soonchunhyang Univ, Dept AI & Big Data, Asan 31538, South Korea
[3] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
[4] Chung Ang Univ, Dept Ind Secur, Seoul 06974, South Korea
关键词
Gait recognition; Covariate factors; Deep learning; Convolutional neural networks; Custom kernel CNN; NEURAL-NETWORKS; IDENTIFICATION;
D O I
10.1016/j.heliyon.2024.e32934
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Gait recognition is the identification of individuals based on how they walk. It can identify an individual of interest without their intervention, making it better suited for surveillance from afar. Computer-aided silhouette-based gait analysis is frequently employed due to its efficiency and effectiveness. However, covariate conditions have a significant influence on individual recognition because they conceal essential features that are helpful in recognizing individuals from their walking style. To address such issues, we proposed a novel deep-learning framework to tackle covariate conditions in gait by proposing regions subject to covariate conditions. The features extracted from those regions will be neglected to keep the model's performance effective with custom kernels. The proposed technique sets aside static and dynamic areas of interest, where static areas contain covariates, and then features are learnt from the dynamic regions unaffected by covariates to effectively recognize individuals. The features were extracted using three customized kernels, and the results were concatenated to produce a fused feature map. Afterward, CNN learns and extracts the features from the proposed regions to recognize an individual. The suggested approach is an end-to-end system that eliminates the requirement for manual region proposal and feature extraction, which would improve gait-based identification of individuals in real-world scenarios. The experimentation is performed on publicly available dataset i.e. CASIA A, and CASIA C. The findings indicate that subjects wearing bags produced 90 % accuracy, and subjects wearing coats produced 58 % accuracy. Likewise, recognizing individuals with different walking speeds also exhibited excellent results, with an accuracy of 94 % for fast and 96 % for slow-paced walk patterns, which shows improvement compared to previous deep learning methods.(c) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页数:13
相关论文
共 50 条
[11]   Gait identification by convolutional neural networks and optical flow [J].
Hawas, Ahmed R. ;
El-Khobby, Heba A. ;
Abd-Elnaby, M. ;
Abd El-Samie, Fathi E. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (18) :25873-25888
[12]   Gait Lateral Network: Learning Discriminative and Compact Representations for Gait Recognition [J].
Hou, Saihui ;
Cao, Chunshui ;
Liu, Xu ;
Huang, Yongzhen .
COMPUTER VISION - ECCV 2020, PT IX, 2020, 12354 :382-398
[13]   Flexible Gait Recognition Based on Flow Regulation of Local Features Between Key Frames [J].
Huang, Guoheng ;
Lu, Zeng ;
Pun, Chi-Man ;
Cheng, Lianglun .
IEEE ACCESS, 2020, 8 :75381-75392
[14]  
Huang XX, 2009, INT CONF ACOUST SPEE, P1469, DOI 10.1109/ICASSP.2009.4959872
[15]   The OU-ISIR Gait Database Comprising the Large Population Dataset and Performance Evaluation of Gait Recognition [J].
Iwama, Haruyuki ;
Okumura, Mayu ;
Makihara, Yasushi ;
Yagi, Yasushi .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2012, 7 (05) :1511-1521
[16]   Gait recognition based on vision systems: A systematic survey [J].
Kumar, Munish ;
Singh, Navdeep ;
Kumar, Ravinder ;
Goel, Shubham ;
Kumar, Krishan .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
[17]   End-to-end Model-based Gait Recognition using Synchronized Multi-view Pose Constraint [J].
Li, Xiang ;
Makihara, Yasushi ;
Xu, Chi ;
Yagi, Yasushi .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :4089-4098
[18]   Discriminant locally linear embedding with high-order tensor data [J].
Li, Xuelong ;
Lin, Stephen ;
Yan, Shuicheng ;
Xu, Dong .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (02) :342-352
[19]   A model-based gait recognition method with body pose and human prior knowledge [J].
Liao, Rijun ;
Yu, Shiqi ;
An, Weizhi ;
Huang, Yongzhen .
PATTERN RECOGNITION, 2020, 98
[20]   Human gait recognition using GEI-based local multi-scale feature descriptors [J].
Lishani, Ait O. ;
Boubchir, Larbi ;
Khalifa, Emad ;
Bouridane, Ahmed .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (05) :5715-5730