A Method for Accurate 3-D Gaze Estimation With a Single Camera and Two Collinear Light Sources

被引:5
作者
Liu, Jiahui [1 ]
Chi, Jiannan [1 ,2 ]
Fan, Shuo [1 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Engn Res Ctr Intelligence Percept & Autonomous Con, Beijing 100124, Peoples R China
关键词
Three-dimensional displays; Estimation; Pupils; Light sources; Cameras; Iris; Optical imaging; Corneal reflection; eye gaze; gaze estimation; iris features; pupil refraction; EYE GAZE; TRACKING; MODEL;
D O I
10.1109/TIM.2022.3210925
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The simplest configuration for estimating 3-D line-of-sight (LoS) based on corneal reflection and pupil refraction uses a single camera and two noncollinear light sources. The corneal radius and 3-D corneal center can be determined by solving a system of six equations with six unknowns. However, when two light sources are collinear with the camera, the reflection planes of the two light sources are coplanar. In this case, the estimation of the 3-D corneal center is underdetermined in the absence of any preknown eyeball parameters (e.g., corneal radius). To solve this issue, this article proposes to calibrate the corneal radius with corneal reflections from two light sources combined with an iris imaging model so that the 3-D corneal center is estimated with a known corneal radius. Then, the pupil features or iris features can be selected to estimate the 3-D pupil center or 3-D iris center, which uses an optimization solution for only the center parameters to avoid unnecessary errors. Thus, the optical axis of the eyeball is constructed with two spatial centers, and the kappa angle calculated in real time is used to convert the optical axis of the eyeball to the 3-D LoS. We simulated this gaze estimation process using pupil and iris features, and performed error analysis on the proposed method. In practical experiments, the proposed method was verified using iris features, and the gaze accuracy was 1.22 degrees and 1.13 degrees in the x - and y -directions, respectively, which is comparable to that of more sophisticated systems. A single-camera-two-collinear-light-source system is the most typical and common system configuration, and the realization of 3-D gaze estimation under such a system configuration can effectively promote the wide application of eye-tracking interaction.
引用
收藏
页数:13
相关论文
共 36 条
  • [21] Toward Optimization of Gaze-Controlled Human-Computer Interaction: Application to Hindi Virtual Keyboard for Stroke Patients
    Meena, Yogesh Kumar
    Cecotti, Hubert
    Wong-Lin, Kongfatt
    Dutta, Ashish
    Prasad, Girijesh
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2018, 26 (04) : 911 - 922
  • [22] Robust eye tracking based on multiple corneal reflections for clinical applications
    Mestre, Clara
    Gautier, Josselin
    Pujol, Jaume
    [J]. JOURNAL OF BIOMEDICAL OPTICS, 2018, 23 (03)
  • [23] Minfeng W., 2015, THESIS SE U DHAKA
  • [24] An eye tracking based virtual reality system for use inside magnetic resonance imaging systems
    Qian, Kun
    Arichi, Tomoki
    Price, Anthony
    Dall'Orso, Sofia
    Eden, Jonathan
    Noh, Yohan
    Rhode, Kawal
    Burdet, Etienne
    Neil, Mark
    Edwards, A. David
    Hajnal, Joseph V.
    [J]. SCIENTIFIC REPORTS, 2021, 11 (01)
  • [25] A novel approach to 3-D gaze tracking using stereo cameras
    Shih, SW
    Liu, J
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (01): : 234 - 245
  • [26] Iris Center Corneal Reflection Method for Gaze Tracking Using Visible Light
    Sigut, Jose
    Sidha, Sid-Ahmed
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2011, 58 (02) : 411 - 419
  • [27] On visual gaze tracking based on a single low cost camera
    Skodras, Evangelos
    Kanas, Vasileios G.
    Fakotakis, Nikolaos
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2015, 36 : 29 - 42
  • [28] Real time gaze estimation with a consumer depth camera
    Sun, Li
    Liu, Zicheng
    Sun, Ming-Ting
    [J]. INFORMATION SCIENCES, 2015, 320 : 346 - 360
  • [29] A novel gaze estimation system with one calibration point
    Villanueva, Arantxa
    Cabeza, Rafael
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (04): : 1123 - 1138
  • [30] Evaluation of Corneal Refraction in a Model of a Gaze Tracking System
    Villanueva, Arantxa
    Cabeza, Rafael
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2008, 55 (12) : 2812 - 2822