Detection of visual pursuits using 1D convolutional neural networks

被引:0
|
作者
Carneiro, Alex Torquato S. [1 ]
Coutinho, Flavio Luiz [2 ]
Morimoto, Carlos H. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Sao Paulo, Sch Arts Sci & Humanities, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Eye tracking; Eye gaze pursuit; Convolutional neural networks; Eye movements classification;
D O I
10.1016/j.patrec.2024.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual pursuit of moving targets is a natural behaviour that has been exploited in, for example, medical diagnosis, law enforcement, and human computer interaction. Most proposed algorithms to detect this behaviour are based on some kind of motion similarity metric that assumes small or no distortion between the trajectory described by the target being pursued and the sensor measurements. We propose a novel algorithm based on 1D Convolutional Neural Networks (1D-CNNs), and investigate the performance of the 1D-CNN against 4 state-ofthe-art similarity based algorithms (SAs), using a novel dataset containing data from 10 participants. Their performances are evaluated using two trajectory shapes (circle and square), two target speeds (120/s and 240/ s), and three window sizes (0.5, 1.0 and 1.5 s). All algorithms have been trained or optimized to maximize the Matthew's Correlation Coefficient (MCC). Our results show that the 1D-CNN outperforms the SAs in all cases, requiring smaller window sizes to robustly detect the pursuits.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [1] Anomaly Detection using 1D Convolutional Neural Networks for Surface Enhanced Raman Scattering
    Mozaffari, M. Hamed
    Tay, Li-Lin
    SPIE FUTURE SENSING TECHNOLOGIES (2020), 2020, 11525
  • [2] 1D convolutional neural networks and applications: A survey
    Kiranyaz, Serkan
    Avci, Onur
    Abdeljaber, Osama
    Ince, Turker
    Gabbouj, Moncef
    Inman, Daniel J.
    MECHANICAL SYSTEMS AND SIGNAL PROCESSING, 2021, 151
  • [3] 1D Convolutional Neural Networks for Detecting Nystagmus
    Newman, Jacob L.
    Phillips, John S.
    Cox, Stephen J.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (05) : 1814 - 1823
  • [4] Tracking Therapy Response in Glioblastoma Using 1D Convolutional Neural Networks
    Ortega-Martorell, Sandra
    Olier, Ivan
    Hernandez, Orlando
    Restrepo-Galvis, Paula D.
    Bellfield, Ryan A. A.
    Candiota, Ana Paula
    CANCERS, 2023, 15 (15)
  • [5] Lipschitz constant estimation for 1D convolutional neural networks
    Pauli, Patricia
    Gramlich, Dennis
    Allgoewer, Frank
    LEARNING FOR DYNAMICS AND CONTROL CONFERENCE, VOL 211, 2023, 211
  • [6] Real-time phonocardiogram anomaly detection by adaptive 1D Convolutional Neural Networks
    Kiranyaz, Serkan
    Zabihi, Morteza
    Rad, Ali Bahrami
    Ince, Turker
    Hamila, Ridha
    Gabbouj, Moncef
    NEUROCOMPUTING, 2020, 411 : 291 - 301
  • [7] Prediction and modelling online reviews helpfulness using 1D Convolutional Neural Networks
    Olmedilla, Maria
    Rocio Martinez-Torres, M.
    Toral, Sergio
    EXPERT SYSTEMS WITH APPLICATIONS, 2022, 198
  • [8] Detection of Alzheimer Disease on Online Handwriting Using 1D Convolutional Neural Network
    Dao, Quang
    El-Yacoubi, Mounim A.
    Rigaud, Anne-Sophie
    IEEE ACCESS, 2023, 11 : 2148 - 2155
  • [9] Computing Transiting Exoplanet Parameters with 1D Convolutional Neural Networks
    Iglesias Alvarez, Santiago
    Diez Alonso, Enrique
    Sanchez Rodriguez, Maria Luisa
    Rodriguez Rodriguez, Javier
    Perez Fernandez, Saul
    de Cos Juez, Francisco Javier
    AXIOMS, 2024, 13 (02)
  • [10] Structural Damage Detection in Real Time: Implementation of 1D Convolutional Neural Networks for SHM Applications
    Avci, Onur
    Abdeljaber, Osama
    Kiranyaz, Serkan
    Inman, Daniel
    STRUCTURAL HEALTH MONITORING & DAMAGE DETECTION, VOL 7, 2017, : 49 - 54