A Simple Model of Reading Eye Movement Based on Deep Learning

被引:0
作者
Wang, Ying [1 ]
Wang, Xiaoming [1 ,2 ]
Wu, Yaowu [1 ]
机构
[1] Xian Int Studies Univ, Grad Sch, Xian 710128, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Natl Engn Lab Integrated Aerosp Ground Ocean Big, Xian 710072, Peoples R China
关键词
Hidden Markov models; Computational modeling; Predictive models; Data models; Labeling; Task analysis; Psychology; Eye-movement model; deep learning; sequence labelling; cognitive computing; SACCADE GENERATION; DYNAMICAL MODEL; FLUENCY;
D O I
10.1109/ACCESS.2020.3033382
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
At present, an increasing amount of research is being conducted on human cognitive behaviour, and reading eye-movement modelling is a research hotspot in cognitive linguistics. However, existing reading eye-movement models are complicated and require a large number of hand-crafted features. To address these issues, this paper improves upon the fixation granularity processing mode and the regression processing mode of the traditional reading eye-movement models and proposes a reading eye-movement fixation sequence labelling method to construct a simpler model. The proposed model is based on a multi-input deep-learning neural network, which takes advantage of deep learning to reduce the number of required hand-crafted features and integrates knowledge from the field of cognitive psychology to increase its accuracy. To meet the data-size requirements of the deep-learning model, this paper also proposes a reading eye-movement data augmentation method. The experimental results show that the proposed method can describe the actual process of reading eye-movement intuitively and that the simple reading eye-movement models based on this method can obtain a similar accuracy with existing models by using fewer hand-crafted features.
引用
收藏
页码:193757 / 193767
页数:11
相关论文
共 35 条
[1]  
[Anonymous], 2019, J TSINGHUA U SCI TEC, DOI DOI 10.13343/J.CNKI.WSXB.20180166
[2]  
[Anonymous], 2012, P 1 WORKSHOP EYE TRA
[3]   Eye movements in reading and information processing: Keith Rayner's 40 year legacy [J].
Clifton, Charles, Jr. ;
Ferreira, Fernanda ;
Henderson, John M. ;
Inhoff, Albrecht W. ;
Liversedge, Simon P. ;
Reichle, Erik D. ;
Schotter, Elizabeth R. .
JOURNAL OF MEMORY AND LANGUAGE, 2016, 86 :1-19
[4]   Presenting GECO: An eyetracking corpus of monolingual and bilingual sentence reading [J].
Cop, Uschi ;
Dirix, Nicolas ;
Drieghe, Denis ;
Duyck, Wouter .
BEHAVIOR RESEARCH METHODS, 2017, 49 (02) :602-615
[5]  
De Vries W., 2019, PROC CEUR WORKSHOP, V2491, P1
[6]   A Robust Online Saccadic Eye Movement Recognition Method Combining Electrooculography and Video [J].
Ding, Xiaojuan ;
Lv, Zhao ;
Zhang, Chao ;
Gao, Xiangping ;
Zhou, Bangyan .
IEEE ACCESS, 2017, 5 :17997-18003
[7]  
Elsayed A. A. H. A., 2019, 65 U POTSD, DOI [10.25932/publishup-46798, DOI 10.25932/PUBLISHUP-46798]
[8]   SWIFT: A dynamical model of saccade generation during reading [J].
Engbert, R ;
Nuthmann, A ;
Richter, EM ;
Kliegl, R .
PSYCHOLOGICAL REVIEW, 2005, 112 (04) :777-813
[9]   A dynamical model of saccade generation in reading based on spatially distributed lexical processing [J].
Engbert, R ;
Longtin, A ;
Kliegl, R .
VISION RESEARCH, 2002, 42 (05) :621-636
[10]  
Hahn M., 2016, P 2016 C EMPIRICAL M, P85, DOI DOI 10.18653/V1/D16-1009