A review of machine learning in scanpath analysis for passive gaze-based interaction

被引:1
作者
Selim, Abdulrahman Mohamed [1 ]
Barz, Michael [1 ,2 ]
Bhatti, Omair Shahzad [1 ]
Alam, Hasan Md Tusfiqur [1 ]
Sonntag, Daniel [1 ,2 ]
机构
[1] German Res Ctr Artificial Intelligence DFKI, Interact Machine Learning Dept, Saarbrucken, Germany
[2] Carl von Ossietzky Univ Oldenburg, Appl Artificial Intelligence, Oldenburg, Germany
来源
FRONTIERS IN ARTIFICIAL INTELLIGENCE | 2024年 / 7卷
关键词
machine learning; eye tracking; scanpath; passive gaze-based interaction; literature review; EYE-MOVEMENT PATTERNS; TRACKING; PREDICTION; CLASSIFICATION; RECOGNITION; ALGORITHMS; VISUALIZATION; ACCURACY; NETWORKS; SEARCH;
D O I
10.3389/frai.2024.1391745
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The scanpath is an important concept in eye tracking. It refers to a person's eye movements over a period of time, commonly represented as a series of alternating fixations and saccades. Machine learning has been increasingly used for the automatic interpretation of scanpaths over the past few years, particularly in research on passive gaze-based interaction, i.e., interfaces that implicitly observe and interpret human eye movements, with the goal of improving the interaction. This literature review investigates research on machine learning applications in scanpath analysis for passive gaze-based interaction between 2012 and 2022, starting from 2,425 publications and focussing on 77 publications. We provide insights on research domains and common learning tasks in passive gaze-based interaction and present common machine learning practices from data collection and preparation to model selection and evaluation. We discuss commonly followed practices and identify gaps and challenges, especially concerning emerging machine learning topics, to guide future research in the field.
引用
收藏
页数:28
相关论文
共 206 条
  • [11] Predicting Decision-Making during an Intelligence Test via Semantic Scanpath Comparisons
    Appel, Tobias
    Bardach, Lisa
    Kasneci, Enkelejda
    [J]. 2022 ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, ETRA 2022, 2022,
  • [12] Stratification of Children with Autism Spectrum Disorder Through Fusion of Temporal Information in Eye-gaze Scan-Paths
    Atyabi, Adham
    Shic, Frederick
    Jiang, Jiajun
    Foster, Claire E.
    Barney, Erin
    Kim, Minah
    Li, Beibin
    Ventola, Pamela
    Chen, Chung Hao
    [J]. ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (02)
  • [13] Badrinarayanan V, 2016, Arxiv, DOI [arXiv:1511.00561, DOI 10.1109/TPAMI.2016.2644615]
  • [14] Assessing the accuracy of prediction algorithms for classification: an overview
    Baldi, P
    Brunak, S
    Chauvin, Y
    Andersen, CAF
    Nielsen, H
    [J]. BIOINFORMATICS, 2000, 16 (05) : 412 - 424
  • [15] Human scanpath prediction based on deep convolutional saccadic model
    Bao, Wentao
    Chen, Zhenzhong
    [J]. NEUROCOMPUTING, 2020, 404 : 154 - 164
  • [16] Barz M., 2021, COMPANION PUBLICATIO, P13, DOI 10.1145/3461615
  • [17] Automatic Recognition and Augmentation of Attended Objects in Real-time using Eye Tracking and a Head-mounted Display
    Barz, Michael
    Kapp, Sebastian
    Kuhn, Jochen
    Sonntag, Daniel
    [J]. ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS (ETRA 2021), 2021,
  • [18] Automatic Visual Attention Detection for Mobile Eye Tracking Using Pre-Trained Computer Vision Models and Human Gaze
    Barz, Michael
    Sonntag, Daniel
    [J]. SENSORS, 2021, 21 (12)
  • [19] Visual Search Target Inference in Natural Interaction Settings with Machine Learning
    Barz, Michael
    Stauden, Sven
    Sonntag, Daniel
    [J]. ETRA'20 FULL PAPERS: ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, 2020,
  • [20] EMIP: The eye movements in programming dataset
    Bednarik, Roman
    Busjahn, Teresa
    Gibaldi, Agostino
    Ahadi, Alireza
    Bielikova, Maria
    Crosby, Martha
    Essig, Kai
    Fagerholm, Fabian
    Jbara, Ahmad
    Lister, Raymond
    Orlov, Pavel
    Paterson, James
    Sharif, Bonita
    Sirkia, Teemu
    Stelovsky, Jan
    Tvarozek, Jozef
    Vrzakova, Hana
    van der Linde, Ian
    [J]. SCIENCE OF COMPUTER PROGRAMMING, 2020, 198