Accurate Regression-Based 3D Gaze Estimation Using Multiple Mapping Surfaces

被引:2
作者
Wan, Zhonghua [1 ]
Xiong, Caihua [1 ]
Li, Quanlin [1 ]
Chen, Wenbin [1 ]
Wong, Kelvin Kian Loong [2 ]
Wu, Shiqian [2 ]
机构
[1] Huazhong Univ Sci & Technol, Inst Rehabil & Med Robot, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
[2] Wuhan Univ Sci & Technol, Inst Robot & Intelligent Syst, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Estimation; Calibration; Cameras; Three-dimensional displays; Head; Gaze tracking; Two dimensional displays; Head-mounted eye tracking; 3D gaze estimation; gaze direction estimation; eyeball center; mapping surface; TRACKING;
D O I
10.1109/ACCESS.2020.3023448
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate 3D gaze estimation using a simple setup remains a challenging issue for head-mounted eye tracking. Current regression-based gaze direction estimation methods implicitly assume that all gaze directions intersect at one point called the eyeball pseudo-center. The effect of this implicit assumption on gaze estimation is unknown. In this paper, we find that this assumption is approximate based on a simulation of all intersections of gaze directions, and it is conditional based on a sensitivity analysis of the assumption in gaze estimation. Hence, we propose a gaze direction estimation method with one mapping surface that satisfies conditions of the assumption by configuring one mapping surface and achieving a high-quality calibration of the eyeball pseudo-center. This method only adds two additional calibration points outside the mapping surface. Furthermore, replacing the eyeball pseudo-center with an additional calibrated surface, we propose a gaze direction estimation method with two mapping surfaces that further improves the accuracy of gaze estimation. This method improves accuracy on the state-of-the-art method by 20 percent (from a mean error of 1.84 degrees to 1.48 degrees) on a public dataset with a usage range of 1 meter and by 17 percent (from a mean error of 2.22 degrees to 1.85 degrees) on a public dataset with a usage range of 2 meters.
引用
收藏
页码:166460 / 166471
页数:12
相关论文
共 50 条
  • [31] Anthropometric Landmark Detection in 3D Head Surfaces Using a Deep Learning Approach
    Torres, Helena R.
    Morais, Pedro
    Fritze, Anne
    Oliveira, Bruno
    Veloso, Fernando
    Ruediger, Mario
    Fonseca, Jaime C.
    Vilaca, Joao L.
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (07) : 2643 - 2654
  • [32] Remote gaze estimation based on 3D face structure and iris centers under natural light
    Xiong, Chunshui
    Huang, Lei
    Liu, Changping
    MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (19) : 11785 - 11799
  • [33] User-Calibration-Free Gaze Estimation Method Using a Binocular 3D Eye Model
    Nagamatsu, Takashi
    Sugano, Ryuichi
    Iwamoto, Yukina
    Kamahara, Junzo
    Tanaka, Naoki
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (09): : 1817 - 1829
  • [34] 3D Pose Estimation Based on Reinforce Learning for 2D Image-Based 3D Model Retrieval
    Nie, Wei-Zhi
    Jia, Wen-Wu
    Li, Wen-Hui
    Liu, An-An
    Zhao, Si-Cheng
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 (23) : 1021 - 1034
  • [35] Accurate 3D Reconstruction using a Turntable-based and Telecentric Vision
    Gonzalez-Barbosa, Jose-Joel
    Gomez-Loenzo, Roberto-Augusto
    Jimenez-Hernandez, Hugo
    Razo, Miguel
    Gonzalez-Barbosa, Ricardo
    AUTOMATIKA, 2015, 56 (04) : 508 - 521
  • [36] POINTING WITH THE EYES: GAZE ESTIMATION USING A STATIC/ACTIVE CAMERA SYSTEM AND 3D IRIS DISK MODEL
    Reale, Michael
    Hung, Terry
    Yin, Lijun
    2010 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME 2010), 2010, : 280 - 285
  • [37] 3D Model-Based Gaze Tracking Via Iris Features With a Single Camera and a Single Light Source
    Liu, Jiahui
    Chi, Jiannan
    Hu, Wenxue
    Wang, Zhiliang
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (02) : 75 - 86
  • [38] Accurate and Efficient 3D Panoptic Mapping Using Diverse Information Modalities and Multidimensional Data Association
    Ying, Zhongmou
    Yuan, Xianfeng
    Song, Boyi
    Song, Yong
    Zhou, Fengyu
    Sheng, Weihua
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (06) : 4489 - 4502
  • [39] 3D motion estimation of hand based on feature points
    Huang, Wen-Qing
    Chen, Hong-Wei
    Zhang, Yun-Hua
    PROCEEDINGS OF 2006 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2006, : 3919 - +
  • [40] RGB-D Semantic Segmentation and Label-Oriented Voxelgrid Fusion for Accurate 3D Semantic Mapping
    Shi, Wenjun
    Xu, Jingwei
    Zhu, Dongchen
    Zhang, Guanghui
    Wang, Xianshun
    Li, Jiamao
    Zhang, Xiaolin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (01) : 183 - 197