Etracker: A Mobile Gaze-Tracking System with Near-Eye Display Based on a Combined Gaze-Tracking Algorithm

被引:25
作者
Li, Bin [1 ,2 ,3 ]
Fu, Hong [3 ]
Wen, Desheng [1 ]
Lo, WaiLun [3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chu Hai Coll Higher Educ, Dept Comp Sci, Tuen Mun, Hong Kong, Peoples R China
关键词
gaze tracking; infrared camera sensor; near-eye viewing device; CNNs; mobile eye tracker;
D O I
10.3390/s18051626
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Eye tracking technology has become increasingly important for psychological analysis, medical diagnosis, driver assistance systems, and many other applications. Various gaze-tracking models have been established by previous researchers. However, there is currently no near-eye display system with accurate gaze-tracking performance and a convenient user experience. In this paper, we constructed a complete prototype of the mobile gaze-tracking system 'Etracker' with a near-eye viewing device for human gaze tracking. We proposed a combined gaze-tracking algorithm. In this algorithm, the convolutional neural network is used to remove blinking images and predict coarse gaze position, and then a geometric model is defined for accurate human gaze tracking. Moreover, we proposed using the mean value of gazes to resolve pupil center changes caused by nystagmus in calibration algorithms, so that an individual user only needs to calibrate it the first time, which makes our system more convenient. The experiments on gaze data from 26 participants show that the eye center detection accuracy is 98% and Etracker can provide an average gaze accuracy of 0.53 degrees at a rate of 30-60 Hz.
引用
收藏
页数:18
相关论文
共 42 条
[1]   A Gaze-Based Driver Distraction Warning System and Its Effect on Visual Behavior [J].
Ahlstrom, Christer ;
Kircher, Katja ;
Kircher, Albert .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2013, 14 (02) :965-973
[2]  
Amos B., 2016, OPENFACE GEN PURPOSE
[3]  
[Anonymous], 2017, ACM INTERACTIVE MOBI
[4]  
Araujo GM, 2014, IEEE IMAGE PROC, P1366, DOI 10.1109/ICIP.2014.7025273
[5]   Multimodal Intelligent Eye-Gaze Tracking System [J].
Biswas, Pradipta ;
Langdon, Pat .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2015, 31 (04) :277-294
[6]   Episcleral surface tracking: challenges and possibilities for using mice sensors for wearable eye tracking [J].
Borsato, Frank H. ;
Morimoto, Carlos H. .
2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, :39-46
[7]   Real-Time Detection and Measurement of Eye Features from Color Images [J].
Borza, Diana ;
Darabant, Adrian Sergiu ;
Danescu, Radu .
SENSORS, 2016, 16 (07)
[8]   Taxonomic Study of Polynomial Regressions Applied to the Calibration of Video-Oculographic Systems [J].
Cerrolaza, Juan J. ;
Villanueva, Arantxa ;
Cabeza, Rafael .
PROCEEDINGS OF THE EYE TRACKING RESEARCH AND APPLICATIONS SYMPOSIUM (ETRA 2008), 2008, :259-266
[9]   Strabismus Recognition Using Eye-Tracking Data and Convolutional Neural Networks [J].
Chen, Zenghai ;
Fu, Hong ;
Lo, Wai-Lun ;
Chi, Zheru .
JOURNAL OF HEALTHCARE ENGINEERING, 2018, 2018
[10]   ExCuSe: Robust Pupil Detection in Real-World Scenarios [J].
Fuhl, Wolfgang ;
Kuebler, Thomas ;
Sippel, Katrin ;
Rosenstiel, Wolfgang ;
Kasneci, Enkelejda .
COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2015, PT I, 2015, 9256 :39-51