A neural network for 3D gaze recording with binocular eye trackers

被引:39
作者
Essig, Kai [1 ]
Pomplun, Marc [2 ]
Ritter, Helge [1 ]
机构
[1] Bielefeld Univ, Neuroinformat Grp, Fac Technol, POB 10 01 31, D-33501 Bielefeld, Germany
[2] Univ Massachusetts, Dept Comp Sci, Boston, MA 02125 USA
关键词
Eye tracking; Neural network; 3D calibration; Anaglyphs;
D O I
10.1080/17445760500354440
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Using eye tracking for the investigation of visual attention has become increasingly popular during the last few decades. Nevertheless, only a small number of eye tracking studies have employed 3D displays, although such displays would closely resemble our natural visual environment. Besides higher cost and effort for the experimental setup, the main reason for the avoidance of 3D displays is the problem of computing a subject's current 3D gaze position based on the measured binocular gaze angles. The geometrical approaches to this problem that have been studied so far involved substantial error in the measurement of 3D gaze trajectories. In order to tackle this problem, we developed an anaglyph-based 3D calibration procedure and used a well-suited type of artificial neural network-a parametrized self-organizing map (PSOM)-to estimate the 3D gaze point from a subject's binocular eye-position data. We report an experiment in which the accuracy of the PSOM gaze-point estimation is compared to a geometrical solution. The results show that the neural network approach produces more accurate results than the geometrical method, especially for the depth axis and for distant stimuli.
引用
收藏
页码:79 / 95
页数:17
相关论文
共 50 条
[41]   Mesh Generation from Dense 3D Scattered Data Using Neural Network [J].
ZHANG Wei JIANG Xianfeng CHEN Lineng MA YaliangDepartment of Mechanical and Electronic Engineering Zhejiang University City College Hangzhou China ;
College of Mechanical and Electronic Engineering Zhejiang University of Technology Hangzhou China ;
JinhuaCollege of Profession and Technology Jinghua China .
Computer Aided Drafting,Design and Manufacturing, 2004, Design and Manufacturing.2004 (01) :30-35
[42]   Neural network analysis applied to tumor segmentation on 3D breast ultrasound images [J].
Huang, Sheng-Fang ;
Chen, Yen-Ching ;
Moon, Woo Kyung .
2008 IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING: FROM NANO TO MACRO, VOLS 1-4, 2008, :1303-+
[43]   3D FEATURE POINT EXTRACTION FROM LIDAR DATA USING A NEURAL NETWORK [J].
Feng, Y. ;
Schlichting, A. ;
Brenner, C. .
XXIII ISPRS CONGRESS, COMMISSION I, 2016, 41 (B1) :563-569
[44]   Face Recognition using 3D GLCM and Elman Levenberg Recurrent Neural Network [J].
Dillak, Rocky Yefrenes ;
Dana, Sumartini ;
Beily, Marthen .
2016 1ST INTERNATIONAL SEMINAR ON APPLICATION FOR TECHNOLOGY OF INFORMATION AND COMMUNICATION (ISEMANTIC): SCIENCE AND TECHNOLOGY FOR A BETTER FUTURE, 2016, :152-156
[45]   Neural network approach for predicting infrared spectra from 3D molecular structure [J].
Al, Saleh Abdul ;
Allouche, Abdul-Rahman .
CHEMICAL PHYSICS LETTERS, 2024, 856
[46]   Complex object 3D measurement based on phase-shifting and a neural network [J].
Li Zhong-wei ;
Shi Yu-sheng ;
Wang Cong-jun ;
Qin Da-hui ;
Huang Kui .
OPTICS COMMUNICATIONS, 2009, 282 (14) :2699-2706
[47]   Photon-Efficient 3D Reconstruction with A Coarse-to-Fine Neural Network [J].
Guo, Shangwei ;
Lai, Zhengchao ;
Li, Jun ;
Han, Shaokun .
OPTICS AND LASERS IN ENGINEERING, 2022, 159
[48]   LIGHTWEIGHT MULTI-VIEW-GROUP NEURAL NETWORK FOR 3D SHAPE CLASSIFICATION [J].
Sun, Jiaqi ;
Niu, Dongmei ;
Lv, Na ;
Dou, Wentao ;
Peng, Jingliang .
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, :3409-3413
[49]   CLUSTERING OF 3D LINE SEGMENTS USING CENTROID NEURAL NETWORK FOR BUILDING DETECTION [J].
Park, Dong-Chul ;
Woo, Dong-Min ;
Kim, Chang-Sun ;
Min, Soo-Young .
JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2014, 23 (05)
[50]   3D Gaze Estimation Using RGB-IR Cameras [J].
Mokatren, Moayad ;
Kuflik, Tsvi ;
Shimshoni, Ilan .
SENSORS, 2023, 23 (01)