Deep-learning-based reading eye-movement analysis for aiding biometric recognition

被引:9
作者
Wang, Xiaoming [1 ]
Zhao, Xinbo [1 ]
Zhang, Yanning [1 ]
机构
[1] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Eye tracking; Eye-movement model; Deep-learning; Biometrics; Identity authentication; Reading eye-movement;
D O I
10.1016/j.neucom.2020.06.137
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eye-movement recognition is a new type of biometric recognition technology. Without considering the characteristics of the stimuli, the existing eye-movement recognition technology is based on eye movement trajectory similarity measurements and uses more eye-movement features. Related studies on reading psychology have shown that when reading text, human eye-movements are different between individuals yet stable for a given individual. This paper proposes a type of technology for aiding biometric recognition based on reading eye-movement. By introducing a deep-learning framework, a computational model for reading eye-movement recognition (REMR) was constructed. The model takes the text, fixation, and text-based linguistic feature sequences as inputs and identifies a human subject by measuring the similarity distance between the predicted fixation sequence and the actual one (to be identified). The experimental results show that the fixation sequence similarity recognition algorithm obtained an equal error rate of 19.4% on the test set, and the model obtained an 86.5% Rank-1 recognition rate on the test set. (c)& nbsp;2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:390 / 398
页数:9
相关论文
共 42 条
[1]  
Barrett M, 2015, AAAI CONF ARTIF INTE, P4231
[2]  
Bicknell K, 2010, ACL 2010: 48TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, P1168
[3]   Eye-movement strategies in developmental prosopagnosia and "super" face recognition [J].
Bobak, Anna K. ;
Parris, Benjamin A. ;
Gregory, Nicola J. ;
Bennetts, Rachel J. ;
Bate, Sarah .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 2017, 70 (02) :201-217
[4]   GANT: Gaze analysis technique for human identification [J].
Cantoni, Virginio ;
Galdi, Chiara ;
Nappi, Michele ;
Porta, Marco ;
Riccio, Daniel .
PATTERN RECOGNITION, 2015, 48 (04) :1027-1038
[5]   WiFi CSI Based Passive Human Activity Recognition Using Attention Based BLSTM [J].
Chen, Zhenghua ;
Zhang, Le ;
Jiang, Chaoyang ;
Cao, Zhiguang ;
Cui, Wei .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (11) :2714-2724
[6]   Eye movements in reading and information processing: Keith Rayner's 40 year legacy [J].
Clifton, Charles, Jr. ;
Ferreira, Fernanda ;
Henderson, John M. ;
Inhoff, Albrecht W. ;
Liversedge, Simon P. ;
Reichle, Erik D. ;
Schotter, Elizabeth R. .
JOURNAL OF MEMORY AND LANGUAGE, 2016, 86 :1-19
[7]  
Dauphin YN, 2015, ADV NEUR IN, V28
[8]  
Dyer C., 2015, ACL IJCNLP 2015
[9]   SWIFT: A dynamical model of saccade generation during reading [J].
Engbert, R ;
Nuthmann, A ;
Richter, EM ;
Kliegl, R .
PSYCHOLOGICAL REVIEW, 2005, 112 (04) :777-813
[10]   Eye movements during multiple object tracking: Where do participants look? [J].
Fehd, Hilda M. ;
Seiffert, Adriane E. .
COGNITION, 2008, 108 (01) :201-209