A neural network for 3D gaze recording with binocular eye trackers

被引:39
作者
Essig, Kai [1 ]
Pomplun, Marc [2 ]
Ritter, Helge [1 ]
机构
[1] Bielefeld Univ, Neuroinformat Grp, Fac Technol, POB 10 01 31, D-33501 Bielefeld, Germany
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
Eye tracking; Neural network; 3D calibration; Anaglyphs;
D O I
10.1080/17445760500354440
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Using eye tracking for the investigation of visual attention has become increasingly popular during the last few decades. Nevertheless, only a small number of eye tracking studies have employed 3D displays, although such displays would closely resemble our natural visual environment. Besides higher cost and effort for the experimental setup, the main reason for the avoidance of 3D displays is the problem of computing a subject's current 3D gaze position based on the measured binocular gaze angles. The geometrical approaches to this problem that have been studied so far involved substantial error in the measurement of 3D gaze trajectories. In order to tackle this problem, we developed an anaglyph-based 3D calibration procedure and used a well-suited type of artificial neural network-a parametrized self-organizing map (PSOM)-to estimate the 3D gaze point from a subject's binocular eye-position data. We report an experiment in which the accuracy of the PSOM gaze-point estimation is compared to a geometrical solution. The results show that the neural network approach produces more accurate results than the geometrical method, especially for the depth axis and for distant stimuli.
引用
收藏
页码:79 / 95
页数:17
相关论文
共 50 条
[21]   3D Motion parameters Estimation Using MRF and Neural Network [J].
Huang, Wenqing ;
Li, Wenjie ;
Hu, Haiyan ;
Wang, Yaming ;
Jiang, Mingfeng .
MECHATRONICS AND INTELLIGENT MATERIALS II, PTS 1-6, 2012, 490-495 :1605-1611
[22]   Geopositioned 3D Areas of Interest for Gaze Analysis [J].
Bickerdt, Jan ;
Sonnenberg, Jan ;
Gollnick, Christian ;
Kasneci, Enkelejda .
AUTOMOTIVEUI '21: 13TH INTERNATIONAL ACM CONFERENCE ON AUTOMOTIVE USER INTERFACES AND INTERACTIVE VEHICULAR APPLICATIONS, 2021, :1-11
[23]   Millimeter-Sized Neural Building Blocks for 3D Heterogeneous Neural Network Assembly [J].
Kato-Negishi, Midori ;
Morimoto, Yuya ;
Onoe, Hiroaki ;
Takeuchi, Shoji .
ADVANCED HEALTHCARE MATERIALS, 2013, 2 (12) :1564-1570
[24]   3D Gaze Point Localization and Visualization Using LiDAR-based 3D Reconstructions [J].
Pieszala, James ;
Diaz, Gabriel ;
Pelz, Jeff ;
Speir, Jacqueline ;
Bailey, Reynold .
2016 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2016), 2016, :201-204
[25]   Research on Integral (3D) Image Compression Technology Based on Neural Network [J].
Zheng, Wanying ;
Piao, Yan .
2012 5TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING (CISP), 2012, :382-386
[26]   Authentication System Using 3D Face With Algorithm DLT and Neural Network [J].
Nickvaldo, Leonardus Alexander ;
Kusnadi, Adhi ;
Wella ;
Winantyo, Rangga ;
Pane, Ivransa Zuhdi .
2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, :186-189
[27]   Neural Network based 3D Mapping Using Depth Image Camera [J].
Dung, Tran Duc ;
Capi, Genci .
2020 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING AND ROBOTICS (ICIPROB 2020, 2020,
[28]   Neural Network-Based 3D IC Interconnect Capacitance Extraction [J].
Kasai, Ryosuke ;
Hachiya, Koutaro ;
Kanamoto, Toshiki ;
Imai, Masashi ;
Kurokawa, Atsushi .
PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON COMMUNICATION ENGINEERING AND TECHNOLOGY (ICCET 2019), 2019, :168-172
[29]   Neural Network Assisted 3D FBAR Modeling With Random Electrode Shapes [J].
He, Xi ;
Tan, Xing Haw Marvin ;
Chen, Ma ;
Huang, Feixuan ;
Yang, Fengyuan ;
Ren, Qinghua ;
Ma, Yiming ;
Chen, Jianlin ;
Wang, Nan .
2024 IEEE MTT-S INTERNATIONAL CONFERENCE ON MICROWAVE ACOUSTICS & MECHANICS, IC-MAM, 2024, :13-16
[30]   Determination of 3D grasping points using stereo matching and neural network [J].
Lee, HK ;
Lee, SR .
OPTOMECHATRONIC SYSTEMS III, 2002, 4902 :285-294