A review of machine learning in scanpath analysis for passive gaze-based interaction

被引:1
作者
Selim, Abdulrahman Mohamed [1 ]
Barz, Michael [1 ,2 ]
Bhatti, Omair Shahzad [1 ]
Alam, Hasan Md Tusfiqur [1 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Interact Machine Learning Dept, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Appl Artificial Intelligence, Oldenburg, Germany
来源
FRONTIERS IN ARTIFICIAL INTELLIGENCE | 2024年 / 7卷
关键词
machine learning; eye tracking; scanpath; passive gaze-based interaction; literature review; EYE-MOVEMENT PATTERNS; TRACKING; PREDICTION; CLASSIFICATION; RECOGNITION; ALGORITHMS; VISUALIZATION; ACCURACY; NETWORKS; SEARCH;
D O I
10.3389/frai.2024.1391745
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.
引用
收藏
页数:28
相关论文
共 206 条
  • [41] The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation
    Chicco, Davide
    Jurman, Giuseppe
    [J]. BMC GENOMICS, 2020, 21 (01)
  • [42] Cho KYHY, 2014, Arxiv, DOI [arXiv:1406.1078, 10.48550/arXiv.1406.1078.]
  • [43] Cho Y., 2021, P 2021 CHI C HUM FAC, P1, DOI DOI 10.1145/3411764.3445577
  • [44] Chuk T., 2014, J. Vis, V14, P1212, DOI [10.1167/14.10.1212, DOI 10.1167/14.10.1212]
  • [45] Is having similar eye movement patterns during face learning and recognition beneficial for recognition performance? Evidence from hidden Markov modeling
    Chuk, Tim
    Chan, Antoni B.
    Hsiao, Janet H.
    [J]. VISION RESEARCH, 2017, 141 : 204 - 216
  • [46] Hidden Markov model analysis reveals the advantage of analytic eye movement patterns in face recognition across cultures
    Chuk, Tim
    Crookes, Kate
    Hayward, William G.
    Chan, Antoni B.
    Hsiao, Janet H.
    [J]. COGNITION, 2017, 169 : 102 - 117
  • [47] Chung J, 2018, AAAI CONF ARTIF INTE, P18
  • [48] Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy
    Combrisson, Etienne
    Jerbi, Karim
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2015, 250 : 126 - 136
  • [49] Analysis of the Learning Process through Eye Tracking Technology and Feature Selection Techniques
    Consuelo Saiz-Manzanares, Maria
    Ramos Perez, Ismael
    Arnaiz Rodriguez, Adrian
    Rodriguez Arribas, Sandra
    Almeida, Leandro
    Francoise Martin, Caroline
    [J]. APPLIED SCIENCES-BASEL, 2021, 11 (13):
  • [50] Scanpath modeling and classification with hidden Markov models
    Coutrot, Antoine
    Hsiao, Janet H.
    Chan, Antoni B.
    [J]. BEHAVIOR RESEARCH METHODS, 2018, 50 (01) : 362 - 379