Reading Detection in Real-time

被引:9
作者
Kelton, Conor [1 ]
Wei, Zijun [1 ]
Ahn, Seoyoung [1 ]
Balasubramanian, Aruna [1 ]
Das, Samir R. [1 ]
Samaras, Dimitris [1 ]
Zelinsky, Gregory [1 ]
机构
[1] SUNY Stony Brook, Stony Brook, NY 11794 USA
来源
ETRA 2019: 2019 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS | 2019年
基金
美国国家科学基金会;
关键词
Reading Detection; Real-time Applications;
D O I
10.1145/3314111.3319916
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Observable reading behavior, the act of moving the eyes over lines of text, is highly stereotyped among the users of a language, and this has led to the development of reading detectors-methods that input windows of sequential fixations and output predictions of the fixation behavior during those windows being reading or skimming. The present study introduces a new method for reading detection using Region Ranking SVM (RRSVM). An SVM-based classifier learns the local oculomotor features that are important for real-time reading detection while it is optimizing for the global reading/skimming classification, making it unnecessary to hand-label local fixation windows for model training. This RRSVM reading detector was trained and evaluated using eye movement data collected in a laboratory context, where participants viewed modified web news articles and had to either read them carefully for comprehension or skim them quickly for the selection of keywords (separate groups). Ground truth labels were known at the global level (the instructed reading or skimming task), and obtained at the local level in a separate rating task. The RRSVM reading detector accurately predicted 82.5% of the global (article-level) reading/skimming behavior, with accuracy in predicting local window labels ranging from 72-95%, depending on how tuned the RRSVM was for local and global weights. With this RRSVM reading detector, a method now exists for near real-time reading detection without the need for hand-labeling of local fixation windows. With real-time reading detection capability comes the potential for applications ranging from education and training to intelligent interfaces that learn what a user is likely to know based on previous detection of their reading behavior.
引用
收藏
页数:5
相关论文
共 16 条
[1]  
Biedert R, 2012, P S EYE TRACK RES AP, P123, DOI DOI 10.1145/2168556.2168575
[2]  
Buscher G, 2009, CHI2009: PROCEEDINGS OF THE 27TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1-4, P21
[3]  
Duggan GB, 2011, 29TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, P1141
[4]   Eye Tracking Scanpath Analysis on Web Pages: How Many Users? [J].
Eraslan, Sukru ;
Yesilada, Yeliz ;
Harper, Simon .
2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, :103-110
[5]   Towards Reading Trackers in the Wild: Detecting Reading Activities by EOG Glasses and Deep Neural Networks [J].
Ishimaru, Shoya ;
Kise, Koichi ;
Hoshika, Kensuke ;
Dengel, Andreas ;
Kunze, Kai .
PROCEEDINGS OF THE 2017 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2017 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (UBICOMP/ISWC '17 ADJUNCT), 2017, :704-711
[6]   Eye Gaze-driven Prediction of Cognitive Differences during Graphical Password Composition [J].
Katsini, Christina ;
Fidas, Christos ;
Raptis, George E. ;
Belk, Marios ;
Samaras, George ;
Avouris, Nikolaos .
IUI 2018: PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES, 2018, :147-152
[7]  
Kelton C, 2017, PROCEEDINGS OF NSDI '17: 14TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, P545
[8]  
Kollmorgen Sepp, 2007, LUND U COGNITIVE STU
[9]  
Raptis George E., 2017, UMAP
[10]   So Much to Read, So Little Time: How Do We Read, and Can Speed Reading Help? [J].
Rayner, Keith ;
Schotter, Elizabeth R. ;
Masson, Michael E. J. ;
Potter, Mary C. ;
Treiman, Rebecca .
PSYCHOLOGICAL SCIENCE IN THE PUBLIC INTEREST, 2016, 17 (01) :4-34