Detection of visual pursuits using 1D convolutional neural networks

被引:0
|
作者
Carneiro, Alex Torquato S. [1 ]
Coutinho, Flavio Luiz [2 ]
Morimoto, Carlos H. [1 ]
机构
[1] Univ Sao Paulo, Inst Math & Stat, Sao Paulo, Brazil
[2] Univ Sao Paulo, Sch Arts Sci & Humanities, Sao Paulo, Brazil
基金
巴西圣保罗研究基金会;
关键词
Eye tracking; Eye gaze pursuit; Convolutional neural networks; Eye movements classification;
D O I
10.1016/j.patrec.2024.01.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The visual pursuit of moving targets is a natural behaviour that has been exploited in, for example, medical diagnosis, law enforcement, and human computer interaction. Most proposed algorithms to detect this behaviour are based on some kind of motion similarity metric that assumes small or no distortion between the trajectory described by the target being pursued and the sensor measurements. We propose a novel algorithm based on 1D Convolutional Neural Networks (1D-CNNs), and investigate the performance of the 1D-CNN against 4 state-ofthe-art similarity based algorithms (SAs), using a novel dataset containing data from 10 participants. Their performances are evaluated using two trajectory shapes (circle and square), two target speeds (120/s and 240/ s), and three window sizes (0.5, 1.0 and 1.5 s). All algorithms have been trained or optimized to maximize the Matthew's Correlation Coefficient (MCC). Our results show that the 1D-CNN outperforms the SAs in all cases, requiring smaller window sizes to robustly detect the pursuits.
引用
收藏
页码:45 / 51
页数:7
相关论文
共 50 条
  • [21] Faster Post-Earthquake Damage Assessment Based on 1D Convolutional Neural Networks
    Yuan, Xinzhe
    Tanksley, Dustin
    Li, Liujun
    Zhang, Haibin
    Chen, Genda
    Wunsch, Donald
    APPLIED SCIENCES-BASEL, 2021, 11 (21):
  • [22] Object Detection Using Convolutional Neural Networks
    Galvez, Reagan L.
    Bandala, Argel A.
    Dadios, Elmer P.
    Vicerra, Ryan Rhay P.
    Maningo, Jose Martin Z.
    PROCEEDINGS OF TENCON 2018 - 2018 IEEE REGION 10 CONFERENCE, 2018, : 2023 - 2027
  • [23] 1D convolutional neural networks-based soil fertility classification and fertilizer prescription
    Sujatha, M.
    Jaidhar, C. D.
    Lingappa, Mallikarjuna
    ECOLOGICAL INFORMATICS, 2023, 78
  • [24] Channel Increment Strategy-Based 1D Convolutional Neural Networks for Seizure Prediction Using Intracranial EEG
    Wang, Xiaoshuang
    Zhang, Chi
    Karkkainen, Tommi
    Chang, Zheng
    Cong, Fengyu
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 316 - 325
  • [25] 1D Convolutional Neural Network for Detecting Ventricular Heartbeats
    Suarez-Leon, A.
    Nunez, J.
    IEEE LATIN AMERICA TRANSACTIONS, 2019, 17 (12) : 1970 - 1977
  • [26] Crack Detection in Paintings Using Convolutional Neural Networks
    Sizyakin, Roman
    Cornelis, Bruno
    Meeus, Laurens
    Dubois, Helene
    Martens, Maximiliaan
    Voronin, Viacheslav
    Pizurica, Aleksandra
    IEEE ACCESS, 2020, 8 : 74535 - 74552
  • [27] Shot Boundary Detection Using Convolutional Neural Networks
    Xu, Jingwei
    Song, Li
    Xie, Rong
    2016 30TH ANNIVERSARY OF VISUAL COMMUNICATION AND IMAGE PROCESSING (VCIP), 2016,
  • [28] Microaneurysm detection using fully convolutional neural networks
    Chudzik, Piotr
    Majumdar, Somshubra
    Caliva, Francesco
    Al-Diri, Bashir
    Hunter, Andrew
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 158 : 185 - 192
  • [29] Robust smile detection using convolutional neural networks
    Bianco, Simone
    Celona, Luigi
    Schettini, Raimondo
    JOURNAL OF ELECTRONIC IMAGING, 2016, 25 (06)
  • [30] Investigation of Pneumonia Detection using Convolutional Neural Networks
    Cicenas, Benediktas
    Abromavicius, Vytautas
    2022 IEEE OPEN CONFERENCE OF ELECTRICAL, ELECTRONIC AND INFORMATION SCIENCES (ESTREAM), 2022,