The Tiny Eye Movement Transformer

被引:0
|
作者
Fuhl, Wolfgang [1 ]
Werner, Anne Herrmann [2 ]
Nieselt, Kay [3 ]
机构
[1] Univ Tubingen, Tubingen, Baden Wurttembe, Germany
[2] TIME Tubingen Inst Med Educ, Tubingen, Baden Wurttembe, Germany
[3] Inst Bioinformat & Med Informat, Tubingen, Baden Wurttembe, Germany
来源
ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, ETRA 2023 | 2023年
关键词
Eye Tracking; Eye Movements; Transformer; NLP; Machine Learning; Classification;
D O I
10.1145/3588015.3590114
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we evaluate different small neural network models for eye movement classification and show our so far developed improved model architecture. For evaluation, we used a subset (1.5 million sequences) of the TEyeDS annotations since it contains in the wild recordings and has the most eye movement annotations to our knowledge. We classified fixations, saccades, and smooth pursuits with four different network architectures and the proposed model improves the equally weighted accuracy by 3.8% to the best competitor while only using 6% of the amount of learnable weights.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] EmMixformer: Mix Transformer for Eye Movement Recognition
    Qin, Huafeng
    Zhu, Hongyu
    Jin, Xin
    Song, Qun
    El-Yacoubi, Mounim A.
    Gao, Xinbo
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2025, 74
  • [2] Prediction of depression symptoms in individual subjects with face and eye movement tracking
    Stolicyn, Aleks
    Steele, J. Douglas
    Series, Peggy
    PSYCHOLOGICAL MEDICINE, 2022, 52 (09) : 1784 - 1792
  • [3] Histogram of oriented velocities for eye movement detection
    Fuhl, Wolfgang
    Castner, Nora
    Kasneci, Enkelejda
    MCPMD'18: PROCEEDINGS OF THE WORKSHOP ON MODELING COGNITIVE PROCESSES FROM MULTIMODAL DATA, 2016,
  • [4] A Tiny Transformer-Based Anomaly Detection Framework for IoT Solutions
    Barbieri, Luca
    Brambilla, Mattia
    Stefanutti, Mario
    Romano, Ciro
    De Carlo, Niccolo
    Roveri, Manuel
    IEEE OPEN JOURNAL OF SIGNAL PROCESSING, 2023, 4 : 462 - 478
  • [5] Tiny-Sepformer: A Tiny Time-Domain Transformer Network for Speech Separation
    Luo, Jian
    Wang, Jianzong
    Cheng, Ning
    Xiao, Edward
    Zhang, Xulong
    Xiao, Jing
    INTERSPEECH 2022, 2022, : 5313 - 5317
  • [6] Rule-based learning for eye movement type detection
    Fuhl, Wolfgang
    Castner, Nora
    Kasneci, Enkelejda
    MCPMD'18: PROCEEDINGS OF THE WORKSHOP ON MODELING COGNITIVE PROCESSES FROM MULTIMODAL DATA, 2016,
  • [7] EALab (Eye Activity Lab): a MATLAB Toolbox for Variable Extraction, Multivariate Analysis and Classification of Eye-Movement Data
    Javier Andreu-Perez
    Celine Solnais
    Kumuthan Sriskandarajah
    Neuroinformatics, 2016, 14 : 51 - 67
  • [8] An Eye Opener on the Use of Machine Learning in Eye Movement Based Authentication
    Peng, Siyuan
    Al Madi, Naser
    2022 ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, ETRA 2022, 2022,
  • [9] EALab (Eye Activity Lab): a MATLAB Toolbox for Variable Extraction, Multivariate Analysis and Classification of Eye-Movement Data
    Andreu-Perez, Javier
    Solnais, Celine
    Sriskandarajah, Kumuthan
    NEUROINFORMATICS, 2016, 14 (01) : 51 - 67
  • [10] A Tiny Transformer for Low-Power Arrhythmia Classification on Microcontrollers
    Busia, Paola
    Scrugli, Matteo Antonio
    Jung, Victor Jean-Baptiste
    Benini, Luca
    Meloni, Paolo
    IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2025, 19 (01) : 142 - 152