Eye-movement Analysis and Prediction using Deep Learning Techniques and Kalman Filter

被引:1
作者
Rafee, Sameer [1 ]
Yun, Xu [1 ]
Xin, Zhang Jian [1 ]
Yemeni, Zaid [2 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Mech Engn & Automat, Hangzhou, Peoples R China
[2] Hohai Univ, Collage Internet Things IoT Engn, Changzhou, Peoples R China
关键词
Eye Movement Classification; Eye Movement Prediction; Convolutional Neural Network (CNN); Recurrent Neural Network (RNN); VIDEO-OCULOGRAPHY; TRACKING; SYSTEM;
D O I
10.14569/IJACSA.2022.01304107
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Eye movement analysis has gained significant attention from the eye-tracking research community, particularly for real-time applications. Eye movement prediction is predominantly required for the improvement of sensor lag. The previously introduced eye-movement approaches focused on classifying eye movements into two categories: saccades and non-saccades. Although these approaches are practical and relatively simple, they confuse fixations and smooth pursuit by putting them up within the non-saccadic category. Moreover, Eye movement analysis has been integrated into different applications, including psychology, neuroscience, human attention analysis, industrial engineering, marketing, advertising, etc. This paper introduces a low-cost eye-movement analysis system using Convolutional Neural Network (CCN) techniques and the Kalman filter to estimate and analyze eye position. The experiment results reveal that the proposed system can accurately classify and predict eye movements and detect pupil position in frames, notwithstanding the face tracking and detection. Additionally, the obtained results revealed that the overall performance of the proposed system is more efficient and effective comparing to Recurrent Neural Network (RNN).
引用
收藏
页码:937 / 949
页数:13
相关论文
共 54 条
  • [1] Infrared oculography - validation of a new method to monitor startle eyeblink amplitudes during fMRI
    Anders, S
    Weiskopf, N
    Lule, D
    Birbaumer, N
    [J]. NEUROIMAGE, 2004, 22 (02) : 767 - 770
  • [2] [Anonymous], 2015, NEUROLOGY EYE MOVEME
  • [3] [Anonymous], 1998, P IEEE 9 EUR SIGN PR
  • [4] Multiscale Fluctuation-Based Dispersion Entropy and Its Applications to Neurological Diseases
    Azami, Named
    Arnold, Steven E.
    Sanei, Saeid
    Chang, Zhuoqing
    Sapiro, Guillermo
    Escudero, Javier
    Gupta, Anoopum S.
    [J]. IEEE ACCESS, 2019, 7 : 68718 - 68733
  • [5] Eye tracking methodology for studying teacher learning: a review of the research
    Beach, Pamela
    McConnel, Jen
    [J]. INTERNATIONAL JOURNAL OF RESEARCH & METHOD IN EDUCATION, 2019, 42 (05) : 485 - 501
  • [6] Bhatia Pavneet., 2020, Interdisciplinary Approaches to Altering Neurodevelopmental Disorders, P107
  • [7] Strabismus Recognition Using Eye-Tracking Data and Convolutional Neural Networks
    Chen, Zenghai
    Fu, Hong
    Lo, Wai-Lun
    Chi, Zheru
    [J]. JOURNAL OF HEALTHCARE ENGINEERING, 2018, 2018
  • [8] Eye Tracking in Virtual Reality
    Clay, Viviane
    Koenig, Peter
    Koenig, Sabine
    [J]. JOURNAL OF EYE MOVEMENT RESEARCH, 2019, 12 (01):
  • [9] Understanding the effects of a teacher video on learning from a multimedia document: an eye-tracking study
    Colliot, Tiphaine
    Jamet, Eric
    [J]. ETR&D-EDUCATIONAL TECHNOLOGY RESEARCH AND DEVELOPMENT, 2018, 66 (06): : 1415 - 1433
  • [10] Eye Tracking the Feedback Assigned to Undergraduate Students in a Digital Assessment Game
    Cutumisu, Maria
    Turgeon, Krystle-Lee
    Saiyera, Tasbire
    Chuong, Steven
    Esparza, Lydia Marion Gonzalez
    MacDonald, Rob
    Kokhan, Vasyl
    [J]. FRONTIERS IN PSYCHOLOGY, 2019, 10