A Method for Accurate 3-D Gaze Estimation With a Single Camera and Two Collinear Light Sources

被引:5
作者
Liu, Jiahui [1 ]
Chi, Jiannan [1 ,2 ]
Fan, Shuo [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Engn Res Ctr Intelligence Percept & Autonomous Con, Beijing 100124, Peoples R China
关键词
Three-dimensional displays; Estimation; Pupils; Light sources; Cameras; Iris; Optical imaging; Corneal reflection; eye gaze; gaze estimation; iris features; pupil refraction; EYE GAZE; TRACKING; MODEL;
D O I
10.1109/TIM.2022.3210925
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The simplest configuration for estimating 3-D line-of-sight (LoS) based on corneal reflection and pupil refraction uses a single camera and two noncollinear light sources. The corneal radius and 3-D corneal center can be determined by solving a system of six equations with six unknowns. However, when two light sources are collinear with the camera, the reflection planes of the two light sources are coplanar. In this case, the estimation of the 3-D corneal center is underdetermined in the absence of any preknown eyeball parameters (e.g., corneal radius). To solve this issue, this article proposes to calibrate the corneal radius with corneal reflections from two light sources combined with an iris imaging model so that the 3-D corneal center is estimated with a known corneal radius. Then, the pupil features or iris features can be selected to estimate the 3-D pupil center or 3-D iris center, which uses an optimization solution for only the center parameters to avoid unnecessary errors. Thus, the optical axis of the eyeball is constructed with two spatial centers, and the kappa angle calculated in real time is used to convert the optical axis of the eyeball to the 3-D LoS. We simulated this gaze estimation process using pupil and iris features, and performed error analysis on the proposed method. In practical experiments, the proposed method was verified using iris features, and the gaze accuracy was 1.22 degrees and 1.13 degrees in the x - and y -directions, respectively, which is comparable to that of more sophisticated systems. A single-camera-two-collinear-light-source system is the most typical and common system configuration, and the realization of 3-D gaze estimation under such a system configuration can effectively promote the wide application of eye-tracking interaction.
引用
收藏
页数:13
相关论文
共 36 条
  • [1] Blignaut P., 2013, PROC S AFR I COMPUT, P56
  • [2] Cai X., 2021, arXiv
  • [3] Gazing point dependent eye gaze estimation
    Cheng, Hong
    Liu, Yaqi
    Fu, Wenhao
    Ji, Yanli
    Yang, Lu
    Zhao, Yang
    Yang, Jie
    [J]. PATTERN RECOGNITION, 2017, 71 : 36 - 44
  • [4] Cheng Y, 2021, arXiv
  • [5] Eye Gaze Tracking With a Web Camera in a Desktop Environment
    Cheung, Yiu-ming
    Peng, Qinmu
    [J]. IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2015, 45 (04) : 419 - 430
  • [6] 3-D Gaze-Estimation Method Using a Multi-Camera-Multi-Light-Source System
    Chi, Jiannan
    Liu, Jiahui
    Wang, Feng
    Chi, Yingkai
    Hou, Zeng-Guang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (12) : 9695 - 9708
  • [7] A Novel Multi-Camera Global Calibration Method for Gaze Tracking System
    Chi, Jiannan
    Yang, Zuoyun
    Zhang, Guosheng
    Liu, Tongbo
    Wang, Zhiliang
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (05) : 2093 - 2104
  • [8] Improving the Usability of Remote Eye Gaze Tracking for Human-Device Interaction
    Choi, Kang-A
    Ma, Chunfei
    Ko, Sung-Jea
    [J]. IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2014, 60 (03) : 493 - 498
  • [9] A fast approach to refraction-aware eye-model fitting and gaze prediction
    Dierkes, Kai
    Kassner, Moritz
    Bulling, Andreas
    [J]. ETRA 2019: 2019 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS, 2019,
  • [10] General theory of remote gaze estimation using the pupil center and corneal reflections
    Guestrin, Elias Daniel
    Eizenman, Moshe
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2006, 53 (06) : 1124 - 1133