Deep Learning Methods for the Prediction of Information Display Type Using Eye Tracking Sequences

被引:0
作者
Yin, Yuehan [1 ]
Alqahtani, Yahya [2 ]
Feng, Jinjuan Heidi [1 ]
Chakraborty, Joyram [1 ]
McGuire, Michael P. [1 ]
机构
[1] Towson Univ, Dept Comp & Informat Sci, Towson, MD 21252 USA
[2] Jazan Univ, Coll Comp Sci & Informat Technol, Jazan, Saudi Arabia
来源
20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021) | 2021年
关键词
Convolutional neural network (CNN); deep learning; eye tracking; recurrent neural network (RNN);
D O I
10.1109/ICMLA52953.2021.00100
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Eye tracking data can help design effective user interfaces by showing how users visually process information. In this study, three neural network models were developed and employed to classify three types of information display methods by using eye gaze data that was collected in visual information processing behavior studies. Eye gaze data was first converted into a sequence and was fed into neural networks to predict the information display type. The results of the study show a comparison between three methods for the creation of eye tracking sequences and how they perform using three neural network models including CNN-LSTM, CNN-GRU, and 3D CNN. The results were positive with all models having an accuracy of higher than 88 percent.
引用
收藏
页码:601 / 605
页数:5
相关论文
共 20 条
  • [1] Alqahtani Y., 2019, Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments, P23
  • [2] Understanding Visual Information Processing for American vs. Saudi Arabian Users
    Alqahtani, Yahya
    Chakraborty, Joyram
    McGuire, Michael
    Feng, Jinjuan Heidi
    [J]. ADVANCES IN DESIGN FOR INCLUSION, 2020, 954 : 229 - 238
  • [3] Long short-term memory
    Hochreiter, S
    Schmidhuber, J
    [J]. NEURAL COMPUTATION, 1997, 9 (08) : 1735 - 1780
  • [4] LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT
    BENGIO, Y
    SIMARD, P
    FRASCONI, P
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02): : 157 - 166
  • [5] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [6] Cho K., 2014, ARXIV, DOI [10.3115/v1/w14-4012, DOI 10.3115/V1/W14-4012]
  • [7] Christensen T., 2018, ARXIV
  • [8] Chung J., ARXIV
  • [9] Elbattah M., 2020, IJCCI
  • [10] Gers FA, 1999, IEE CONF PUBL, P850, DOI [10.1162/089976600300015015, 10.1049/cp:19991218]