A neural network for 3D gaze recording with binocular eye trackers

被引:39
作者
Essig, Kai [1 ]
Pomplun, Marc [2 ]
Ritter, Helge [1 ]
机构
[1] Bielefeld Univ, Neuroinformat Grp, Fac Technol, POB 10 01 31, D-33501 Bielefeld, Germany
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
Eye tracking; Neural network; 3D calibration; Anaglyphs;
D O I
10.1080/17445760500354440
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Using eye tracking for the investigation of visual attention has become increasingly popular during the last few decades. Nevertheless, only a small number of eye tracking studies have employed 3D displays, although such displays would closely resemble our natural visual environment. Besides higher cost and effort for the experimental setup, the main reason for the avoidance of 3D displays is the problem of computing a subject's current 3D gaze position based on the measured binocular gaze angles. The geometrical approaches to this problem that have been studied so far involved substantial error in the measurement of 3D gaze trajectories. In order to tackle this problem, we developed an anaglyph-based 3D calibration procedure and used a well-suited type of artificial neural network-a parametrized self-organizing map (PSOM)-to estimate the 3D gaze point from a subject's binocular eye-position data. We report an experiment in which the accuracy of the PSOM gaze-point estimation is compared to a geometrical solution. The results show that the neural network approach produces more accurate results than the geometrical method, especially for the depth axis and for distant stimuli.
引用
收藏
页码:79 / 95
页数:17
相关论文
共 50 条
[31]   Rapid surface registration of 3D volumes using a neural network approach [J].
Zhang, J. ;
Ge, Y. ;
Ong, S. H. ;
Chui, C. K. ;
Teoh, S. H. ;
Yan, C. H. .
IMAGE AND VISION COMPUTING, 2008, 26 (02) :201-210
[32]   Neural-network-based photometric stereo for 3D surface reconstruction [J].
Cheng, Wen-Chang .
2006 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORK PROCEEDINGS, VOLS 1-10, 2006, :404-410
[33]   3D ultrasound computed tomography system calibration using a neural network [J].
Wang, Hongjian ;
Shen, Ning ;
Lei, Xiaoxu ;
Gemmeke, Hartmut ;
Zapf, Michael ;
Yu, Shoujian ;
Xia, Xiaoling .
MEDICAL IMAGING 2022: ULTRASONIC IMAGING AND TOMOGRAPHY, 2022, 12038
[34]   Path Planning Algorithm for Robot in 3D Environment Based on Neural Network [J].
Yu, Jianli ;
Zhang, Qifeng ;
Kroumov, Valeri ;
Cheng, Siya ;
Zhang, Zongwei .
INTELLIGENT ROBOTICS AND APPLICATIONS, PT I, PROCEEDINGS, 2008, 5314 :1081-+
[35]   An Algorithm for Solving the Pose of Bio 3D Printing based on Neural Network [J].
Liu, Jian ;
Song, Zili ;
Zhu, Huixuan ;
Yuan, Hang .
2022 34TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2022, :1691-1696
[36]   Fast 3D lithography simulation by convolutional neural network: POC study [J].
Tanabe, Hiroyoshi ;
Sato, Shimpei ;
Takahashi, Atsushi .
PHOTOMASK TECHNOLOGY 2020, 2020, 11518
[37]   Learning a 3D Gaze Estimator With Adaptive Weighted Strategy [J].
Zhou, Xiaolong ;
Jiang, Jiaqi ;
Liu, Qianqian ;
Fang, Jianwen ;
Chen, Shengyong ;
Cai, Haibin .
IEEE ACCESS, 2020, 8 :82142-82152
[38]   Fast 3D reconstruction of Ultrasonic Images Based on Generalized Regression Neural Network [J].
Asad, Babakhani ;
Du Zhi-jiang ;
Sun Li-ning ;
Reza, Kardan ;
Fereidoun, Mianji A. .
WORLD CONGRESS ON MEDICAL PHYSICS AND BIOMEDICAL ENGINEERING 2006, VOL 14, PTS 1-6, 2007, 14 :3117-+
[39]   Dynamic Hand Gesture Recognition Based on 3D Convolutional Neural Network Models [J].
Zhang, Wenjin ;
Wang, Jiacun .
PROCEEDINGS OF THE 2019 IEEE 16TH INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC 2019), 2019, :224-229
[40]   Mesh Generation from Dense 3D Scattered Data Using Neural Network [J].
ZHANG Wei ;
College of Mechanical and Electronic Engineering ;
JinhuaCollege of Profession and Technology .
ComputerAidedDrafting,DesignandManufacturing, 2004, DesignandManufacturing.2004 (01) :30-35