A neural network for 3D gaze recording with binocular eye trackers

被引:39
作者
Essig, Kai [1 ]
Pomplun, Marc [2 ]
Ritter, Helge [1 ]
机构
[1] Bielefeld Univ, Neuroinformat Grp, Fac Technol, POB 10 01 31, D-33501 Bielefeld, Germany
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
Eye tracking; Neural network; 3D calibration; Anaglyphs;
D O I
10.1080/17445760500354440
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Using eye tracking for the investigation of visual attention has become increasingly popular during the last few decades. Nevertheless, only a small number of eye tracking studies have employed 3D displays, although such displays would closely resemble our natural visual environment. Besides higher cost and effort for the experimental setup, the main reason for the avoidance of 3D displays is the problem of computing a subject's current 3D gaze position based on the measured binocular gaze angles. The geometrical approaches to this problem that have been studied so far involved substantial error in the measurement of 3D gaze trajectories. In order to tackle this problem, we developed an anaglyph-based 3D calibration procedure and used a well-suited type of artificial neural network-a parametrized self-organizing map (PSOM)-to estimate the 3D gaze point from a subject's binocular eye-position data. We report an experiment in which the accuracy of the PSOM gaze-point estimation is compared to a geometrical solution. The results show that the neural network approach produces more accurate results than the geometrical method, especially for the depth axis and for distant stimuli.
引用
收藏
页码:79 / 95
页数:17
相关论文
共 50 条
  • [21] View Interpolation using Neural Network for Fullsphere 3D Telepresence
    Sakai, Kazuki
    Nakata, Takayuki
    Mathuda, Hironari
    2018 INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT), 2018,
  • [22] 3D Gaze Point Localization and Visualization Using LiDAR-based 3D Reconstructions
    Pieszala, James
    Diaz, Gabriel
    Pelz, Jeff
    Speir, Jacqueline
    Bailey, Reynold
    2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, : 201 - 204
  • [23] Millimeter-Sized Neural Building Blocks for 3D Heterogeneous Neural Network Assembly
    Kato-Negishi, Midori
    Morimoto, Yuya
    Onoe, Hiroaki
    Takeuchi, Shoji
    ADVANCED HEALTHCARE MATERIALS, 2013, 2 (12) : 1564 - 1570
  • [24] An Algorithm for Solving the Pose of Bio 3D Printing based on Neural Network
    Liu, Jian
    Song, Zili
    Zhu, Huixuan
    Yuan, Hang
    2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, : 1691 - 1696
  • [25] Neural Network-Based 3D IC Interconnect Capacitance Extraction
    Kasai, Ryosuke
    Hachiya, Koutaro
    Kanamoto, Toshiki
    Imai, Masashi
    Kurokawa, Atsushi
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON COMMUNICATION ENGINEERING AND TECHNOLOGY (ICCET 2019), 2019, : 168 - 172
  • [26] Neural Network based 3D Mapping Using Depth Image Camera
    Dung, Tran Duc
    Capi, Genci
    2020 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB 2020, 2020,
  • [27] Neural Network Assisted 3D FBAR Modeling With Random Electrode Shapes
    He, Xi
    Tan, Xing Haw Marvin
    Chen, Ma
    Huang, Feixuan
    Yang, Fengyuan
    Ren, Qinghua
    Ma, Yiming
    Chen, Jianlin
    Wang, Nan
    2024 IEEE MTT-S INTERNATIONAL CONFERENCE ON MICROWAVE ACOUSTICS & MECHANICS, IC-MAM, 2024, : 13 - 16
  • [28] Authentication System Using 3D Face With Algorithm DLT and Neural Network
    Nickvaldo, Leonardus Alexander
    Kusnadi, Adhi
    Wella
    Winantyo, Rangga
    Pane, Ivransa Zuhdi
    2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 186 - 189
  • [29] Research on Integral (3D) Image Compression Technology Based on Neural Network
    Zheng, Wanying
    Piao, Yan
    2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, : 382 - 386
  • [30] OPEN PIT OPTIMIZATION IN 3D USING A NEW ARTIFICIAL NEURAL NETWORK
    Sayadi, Ahmad Reza
    Fathianpour, Nader
    Mousavi, Amin Allah
    ARCHIVES OF MINING SCIENCES, 2011, 56 (03) : 389 - 403