Cross-view gait recognition based on residual long short-term memory

被引:0
作者
Junqin Wen
Xiuhui Wang
机构
[1] Zhejiang Technical Institute of Economics,Key Laboratory of Electromagnetic Wave Information Technology and Metrology of Zhejiang Province, College of Information Engineering
[2] China Jiliang University,undefined
来源
Multimedia Tools and Applications | 2021年 / 80卷
关键词
Gait classification; Deep learning; Long short-term memory; Residual network;
D O I
暂无
中图分类号
学科分类号
摘要
As a promising biometric recognition technology, gait recognition has many advantages, such as non-invasive, easy to implement in a long distance, but it is very sensitive to the change of video acquisition angles. In this paper, we propose a novel cross-view gait recognition framework based on residual long short-term memory, namely, CVGR-RLSTM, to extract intrinsic gait features and carry out gait recognition. The proposed framework captures dependencies of human postures in time dimension during walking by inputting randomly sampling frame-by-frame gait energy images. The frame-by-frame gait energy images are generated by merging adjacent gait silhouette images sequentially, which integrates gait features of temporal and spatial dimensions to a certain extent. In the CVGR-RLSTM framework, the embedded residual module is used to further refine the spatial gait features, and the LSTM module is utilized to optimize the temporal gait features. To evaluate the proposed framework, we carried out a series of comparative experiments on the CASIA Dataset B and OU-ISIR LP Dataset. Experimental results show that the proposed method reaches the state-of-the-art level.
引用
收藏
页码:28777 / 28788
页数:11
相关论文
共 84 条
[1]  
Battistone F(2019)Tglstm: A time based graph deep learning approach to gait recognition Pattern Recogn Lett 126 132-138
[2]  
Petrosino A(2013)Gait recognition using hmms and dual discriminative observations for sub-dynamics analysis IEEE Trans Image Process 22 3636-3647
[3]  
Boulgouris NV(2017)Fusion of spatial-temporal and kinematic features for gait recognition with deterministic learning Pattern Recogn 67 186-200
[4]  
Huang X(2021)Combining cnn and lstm for activity of daily living recognition with a 3d matrix skeleton representation Intel Serv Robot 14 1-11
[5]  
Deng M(2016)Evaluation of local spatial-temporal features for cross-view action recognition Neurocomput. 173 110-117
[6]  
Wang C(2019)Adaptive fusion and category-level dictionary learning model for multiview human action recognition IEEE Internet of Things Journal 6 9280-9293
[7]  
Cheng F(2006)Individual recognition using gait energy image. IEEE Trans Pattern Anal Mach Intell 28 316-322
[8]  
Zeng W(2012)Employing a rgb-d sensor for real-time tracking of humans across multiple re-entries in a smart environment IEEE Trans Consum Electron 58 255-263
[9]  
Ercolano G(2015)Multimodal deep autoencoder for human pose recovery IEEE Trans Image Process 24 5659-5670
[10]  
Rossi S(2019)Multimodal face-pose estimation with multitask manifold deep learning IEEE Transactions on Industrial Informatics 15 3952-3961