Deep Learning-Based Gait Recognition Using Smartphones in the Wild

被引:164
作者
Zou, Qin [1 ]
Wang, Yanling [2 ]
Wang, Qian [2 ]
Zhao, Yi [1 ]
Li, Qingquan [3 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430079, Peoples R China
[3] Shenzhen Univ, Shenzhen Key Lab Spatial Smart Sensing & Serv, Shenzhen 518060, Peoples R China
关键词
Gait recognition; Sensors; Smart phones; Legged locomotion; Authentication; Time series analysis; inertial sensor; person identification; convolutional neural network; recurrent neural network; PERFORMANCE EVALUATION; AUTHENTICATION; ACCELEROMETER; SEQUENCES; IDENTITY; DATABASE; PATTERN;
D O I
10.1109/TIFS.2020.2985628
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Compared to other biometrics, gait is difficult to conceal and has the advantage of being unobtrusive. Inertial sensors, such as accelerometers and gyroscopes, are often used to capture gait dynamics. These inertial sensors are commonly integrated into smartphones and are widely used by the average person, which makes gait data convenient and inexpensive to collect. In this paper, we study gait recognition using smartphones in the wild. In contrast to traditional methods, which often require a person to walk along a specified road and/or at a normal walking speed, the proposed method collects inertial gait data under unconstrained conditions without knowing when, where, and how the user walks. To obtain good person identification and authentication performance, deep-learning techniques are presented to learn and model the gait biometrics based on walking data. Specifically, a hybrid deep neural network is proposed for robust gait feature representation, where features in the space and time domains are successively abstracted by a convolutional neural network and a recurrent neural network. In the experiments, two datasets collected by smartphones for a total of 118 subjects are used for evaluations. The experiments show that the proposed method achieves higher than 93.5% and 93.7% accuracies in person identification and authentication, respectively.
引用
收藏
页码:3197 / 3212
页数:16
相关论文
共 95 条
[1]  
Abujrida H, 2017, 2017 IEEE-NIH HEALTHCARE INNOVATIONS AND POINT OF CARE TECHNOLOGIES (HI-POCT), P208, DOI 10.1109/HIC.2017.8227621
[2]   The ORL active floor [J].
Addlesee, MD ;
Jones, A ;
Livesey, F ;
Samaria, F .
IEEE PERSONAL COMMUNICATIONS, 1997, 4 (05) :35-41
[3]   Identifying people from gait pattern with accelerometers [J].
Ailisto, H ;
Lindholm, M ;
Mäntyjärvi, J ;
Vildjiounaite, E ;
Mäkelä, SM .
BIOMETRIC TECHNOLOGY FOR HUMAN IDENTIFICATION II, 2005, 5779 :7-14
[4]   Improved gait recognition based on specialized deep convolutional neural network [J].
Alotaibi, Munif ;
Mahmood, Ausif .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 164 :103-110
[5]  
Alsheikh M.A., 2016, P AAAI C ART INT PHO
[6]   Improving Gait Recognition with 3D Pose Estimation [J].
An, Weizhi ;
Liao, Rijun ;
Yu, Shiqi ;
Huang, Yongzhen ;
Yuen, Pong C. .
BIOMETRIC RECOGNITION, CCBR 2018, 2018, 10996 :137-147
[7]  
[Anonymous], ARXIV160601609
[8]  
[Anonymous], 2016, P 25 INT JOINT C ART
[9]  
[Anonymous], 2016, ADV NEUR INF PROC SY, DOI [DOI 10.2165/00129785-200404040-00005, DOI 10.1145/3065386]
[10]   Frontal Gait Recognition From Incomplete Sequences Using RGB-D Camera [J].
Chattopadhyay, Pratik ;
Sural, Shamik ;
Mukherjee, Jayanta .
IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2014, 9 (11) :1843-1856