An End-to-End Multi-Task and Fusion CNN for Inertial-Based Gait Recognition

被引:49
作者
Delgado-Escano, Ruben [1 ]
Castro, Francisco M. [1 ]
Cozar, Julian Ramos [1 ]
Marin-Jimenez, Manuel J. [2 ]
Guil, Nicolas [1 ]
机构
[1] Univ Malaga, Dept Comp Architecture, E-29071 Malaga, Spain
[2] Univ Cordoba, Dept Comp Sci & Numer Anal, E-14071 Cordoba, Spain
关键词
Gait; inertial; CNN; fusion; multi-task; PERFORMANCE EVALUATION; AUTHENTICATION; DATABASE;
D O I
10.1109/ACCESS.2018.2886899
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
People identification using gait information (i.e., the way a person walks) obtained from inertial sensors is a robust approach that can be used in multiple situations where vision-based systems are not applicable. Typically, previous methods use hand-crafted features or deep learning approaches with pre-processed features as input. In contrast, we present a new deep learning-based end-to-end approach that employs raw inertial data as input. By this way, our approach is able to automatically learn the best representations without any constraint introduced by the pre-processed features. Moreover, we study the fusion of information from multiple inertial sensors and multi-task learning from multiple labels per sample. Our proposal is experimentally validated on the challenging dataset OU-ISIR, which is the largest available dataset for gait recognition using inertial information. After conducting an extensive set of experiments to obtain the best hyper-parameters, our approach is able to achieve state-of-the-art results. Specifically, we improve both the identification accuracy (from 83.8% to 94.8%) and the authentication equal-error-rate (from 5.6 to 1.1). Our experimental results suggest that: 1) the use of hand-crafted features is not necessary for this task as deep learning approaches using raw data achieve better results; 2) the fusion of information from multiple sensors allows to improve the results; and, 3) multi-task learning is able to produce a single model that obtains similar or even better results in multiple tasks than the corresponding models trained for a single task.
引用
收藏
页码:1897 / 1908
页数:12
相关论文
共 59 条
  • [1] Anguita D., 2012, INT WORKSH AMB ASS L, P216
  • [2] [Anonymous], 2015, 2015 IEEE APPL IM PA
  • [3] [Anonymous], 2007, Annual Norwegian Computer Science Conference
  • [4] [Anonymous], 2017 INT C INF TECHN
  • [5] [Anonymous], 2012, P 11 INT C MOB UB MU
  • [6] [Anonymous], 2014, 2014 IEEEIAPR INT
  • [7] [Anonymous], IDNET SMARTPHONE BAS
  • [8] Bächlin M, 2009, LECT NOTES COMPUT SC, V5558, P1040, DOI 10.1007/978-3-642-01793-3_105
  • [9] Boulgouris NV, 2004, 2004 IEEE 6TH WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING, P263
  • [10] Fisher Motion Descriptor for Multiview Gait Recognition
    Castro, F. M.
    Marin-Jimenez, M. J.
    Guil Mata, N.
    Munoz-Salinas, R.
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2017, 31 (01)