Detection of visual pursuits using 1D convolutional neural networks

被引:0
|
作者
Carneiro, Alex Torquato S. [1 ]
Coutinho, Flavio Luiz [2 ]
Morimoto, Carlos H. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Sao Paulo, Sch Arts Sci & Humanities, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Eye tracking; Eye gaze pursuit; Convolutional neural networks; Eye movements classification;
D O I
10.1016/j.patrec.2024.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual pursuit of moving targets is a natural behaviour that has been exploited in, for example, medical diagnosis, law enforcement, and human computer interaction. Most proposed algorithms to detect this behaviour are based on some kind of motion similarity metric that assumes small or no distortion between the trajectory described by the target being pursued and the sensor measurements. We propose a novel algorithm based on 1D Convolutional Neural Networks (1D-CNNs), and investigate the performance of the 1D-CNN against 4 state-ofthe-art similarity based algorithms (SAs), using a novel dataset containing data from 10 participants. Their performances are evaluated using two trajectory shapes (circle and square), two target speeds (120/s and 240/ s), and three window sizes (0.5, 1.0 and 1.5 s). All algorithms have been trained or optimized to maximize the Matthew's Correlation Coefficient (MCC). Our results show that the 1D-CNN outperforms the SAs in all cases, requiring smaller window sizes to robustly detect the pursuits.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [31] Seam Carving Detection Using Convolutional Neural Networks
    da Silva Cieslak, Luiz Fernando
    Pontara da Costa, Kelton Augusto
    Papa, Joao Paulo
    2018 IEEE 12TH INTERNATIONAL SYMPOSIUM ON APPLIED COMPUTATIONAL INTELLIGENCE AND INFORMATICS (SACI), 2018, : 195 - 199
  • [32] Visual Percepts Quality Recognition Using Convolutional Neural Networks
    Billones, Robert Kerwin C.
    Bandala, Argel A.
    Lim, Laurence A. Gan
    Sybingco, Edwin
    Fillone, Alexis M.
    Dadios, Elmer P.
    ADVANCES IN COMPUTER VISION, VOL 2, 2020, 944 : 652 - 665
  • [33] Driver Drowsiness Detection Using Convolutional Neural Networks
    Kepesiova, Zuzana
    Ciganek, Jan
    Kozak, Stefan
    PROCEEDINGS OF THE 2020 30TH INTERNATIONAL CONFERENCE CYBERNETICS & INFORMATICS (K&I '20), 2020,
  • [34] NEONATAL SEIZURE DETECTION USING CONVOLUTIONAL NEURAL NETWORKS
    O'Shea, Alison
    Lightbody, Gordon
    Boylan, Geraldine
    Temko, Andriy
    2017 IEEE 27TH INTERNATIONAL WORKSHOP ON MACHINE LEARNING FOR SIGNAL PROCESSING, 2017,
  • [35] Structural Damage Detection Using Convolutional Neural Networks
    Gulgec, Nur Sila
    Takac, Martin
    Pakzad, Shamim N.
    MODEL VALIDATION AND UNCERTAINTY QUANTIFICATION, VOL 3, 2017, : 331 - 337
  • [36] Extraction of physicochemical properties from the fluorescence spectrum with 1D convolutional neural networks: Application to olive oil
    Venturini, Francesca
    Sperti, Michela
    Michelucci, Umberto
    Gucciardi, Arnaud
    Martos, Vanessa M.
    Deriu, Marco A.
    JOURNAL OF FOOD ENGINEERING, 2023, 336
  • [37] Convolutional neural networks: an approach for visual obstruction detection in automotive reversing camer
    Reveles-Gomez, Luis C.
    Luna-Garcia, Huizilopoztli
    Celaya-Padilla, Jose M.
    Garcia-Hernandez, Rosa A.
    DYNA, 2024, 99 (02): : 181 - 187
  • [38] Automatic detection and classification of leukocytes using convolutional neural networks
    Jianwei Zhao
    Minshu Zhang
    Zhenghua Zhou
    Jianjun Chu
    Feilong Cao
    Medical & Biological Engineering & Computing, 2017, 55 : 1287 - 1301
  • [39] BRAIN TUMOUR DETECTION USING CONVOLUTIONAL NEURAL NETWORKS AND DECONVOLUTION
    Sai, B. Shashank
    Nithin, K.
    Reddy, T. Vineeth
    Suma, T.
    Babu, P. Ashok
    PROCEEDINGS OF THE 2021 FIFTH INTERNATIONAL CONFERENCE ON I-SMAC (IOT IN SOCIAL, MOBILE, ANALYTICS AND CLOUD) (I-SMAC 2021), 2021, : 1007 - 1012
  • [40] Automatic detection and classification of leukocytes using convolutional neural networks
    Zhao, Jianwei
    Zhang, Minshu
    Zhou, Zhenghua
    Chu, Jianjun
    Cao, Feilong
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2017, 55 (08) : 1287 - 1301