Deep Learning-Based Gait Recognition Using Smartphones in the Wild

被引:164
作者
Zou, Qin [1 ]
Wang, Yanling [2 ]
Wang, Qian [2 ]
Zhao, Yi [1 ]
Li, Qingquan [3 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430079, Peoples R China
[3] Shenzhen Univ, Shenzhen Key Lab Spatial Smart Sensing & Serv, Shenzhen 518060, Peoples R China
关键词
Gait recognition; Sensors; Smart phones; Legged locomotion; Authentication; Time series analysis; inertial sensor; person identification; convolutional neural network; recurrent neural network; PERFORMANCE EVALUATION; AUTHENTICATION; ACCELEROMETER; SEQUENCES; IDENTITY; DATABASE; PATTERN;
D O I
10.1109/TIFS.2020.2985628
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Compared to other biometrics, gait is difficult to conceal and has the advantage of being unobtrusive. Inertial sensors, such as accelerometers and gyroscopes, are often used to capture gait dynamics. These inertial sensors are commonly integrated into smartphones and are widely used by the average person, which makes gait data convenient and inexpensive to collect. In this paper, we study gait recognition using smartphones in the wild. In contrast to traditional methods, which often require a person to walk along a specified road and/or at a normal walking speed, the proposed method collects inertial gait data under unconstrained conditions without knowing when, where, and how the user walks. To obtain good person identification and authentication performance, deep-learning techniques are presented to learn and model the gait biometrics based on walking data. Specifically, a hybrid deep neural network is proposed for robust gait feature representation, where features in the space and time domains are successively abstracted by a convolutional neural network and a recurrent neural network. In the experiments, two datasets collected by smartphones for a total of 118 subjects are used for evaluations. The experiments show that the proposed method achieves higher than 93.5% and 93.7% accuracies in person identification and authentication, respectively.
引用
收藏
页码:3197 / 3212
页数:16
相关论文
共 95 条
[51]  
Ngo Thanh Trung, 2012, 2012 5th IAPR International Conference on Biometrics (ICB), P360, DOI 10.1109/ICB.2012.6199833
[52]  
Nixon M., 2006, Human Identification Based on Gait
[53]   Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition [J].
Ordonez, Francisco Javier ;
Roggen, Daniel .
SENSORS, 2016, 16 (01)
[54]  
Plotz T., 2011, 22 INT JOINT C ART I, DOI DOI 10.5591/978-1-57735-516-8/IJCAI11-290
[55]   The Security of Autonomous Driving: Threats, Defenses, and Future Directions [J].
Ren, Kui ;
Wang, Qian ;
Wang, Cong ;
Qin, Zhan ;
Lin, Xiaodong .
PROCEEDINGS OF THE IEEE, 2020, 108 (02) :357-372
[56]   User Verification Leveraging Gait Recognition for Smartphone Enabled Mobile Healthcare Systems [J].
Ren, Yanzhi ;
Chen, Yingying ;
Chuah, Mooi Choo ;
Yang, Jie .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2015, 14 (09) :1961-1974
[57]   Robust gait recognition: a comprehensive survey [J].
Rida, Imad ;
Almaadeed, Noor ;
Almaadeed, Somaya .
IET BIOMETRICS, 2019, 8 (01) :14-28
[58]  
Rijun Liao, 2017, Biometric Recognition. 12th Chinese Conference, CCBR 2017. Proceedings: LNCS 10568, P474, DOI 10.1007/978-3-319-69923-3_51
[59]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[60]   Saliency-Aware Convolution Neural Network for Ship Detection in Surveillance Video [J].
Shao, Zhenfeng ;
Wang, Linggang ;
Wang, Zhongyuan ;
Du, Wan ;
Wu, Wenjing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (03) :781-794