Accurate Regression-Based 3D Gaze Estimation Using Multiple Mapping Surfaces

被引:2
作者
Wan, Zhonghua [1 ]
Xiong, Caihua [1 ]
Li, Quanlin [1 ]
Chen, Wenbin [1 ]
Wong, Kelvin Kian Loong [2 ]
Wu, Shiqian [2 ]
机构
[1] Huazhong Univ Sci & Technol, Inst Rehabil & Med Robot, State Key Lab Digital Mfg Equipment & Technol, Wuhan 430074, Peoples R China
[2] Wuhan Univ Sci & Technol, Inst Robot & Intelligent Syst, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
来源
IEEE ACCESS | 2020年 / 8卷
基金
中国国家自然科学基金;
关键词
Estimation; Calibration; Cameras; Three-dimensional displays; Head; Gaze tracking; Two dimensional displays; Head-mounted eye tracking; 3D gaze estimation; gaze direction estimation; eyeball center; mapping surface; TRACKING;
D O I
10.1109/ACCESS.2020.3023448
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate 3D gaze estimation using a simple setup remains a challenging issue for head-mounted eye tracking. Current regression-based gaze direction estimation methods implicitly assume that all gaze directions intersect at one point called the eyeball pseudo-center. The effect of this implicit assumption on gaze estimation is unknown. In this paper, we find that this assumption is approximate based on a simulation of all intersections of gaze directions, and it is conditional based on a sensitivity analysis of the assumption in gaze estimation. Hence, we propose a gaze direction estimation method with one mapping surface that satisfies conditions of the assumption by configuring one mapping surface and achieving a high-quality calibration of the eyeball pseudo-center. This method only adds two additional calibration points outside the mapping surface. Furthermore, replacing the eyeball pseudo-center with an additional calibrated surface, we propose a gaze direction estimation method with two mapping surfaces that further improves the accuracy of gaze estimation. This method improves accuracy on the state-of-the-art method by 20 percent (from a mean error of 1.84 degrees to 1.48 degrees) on a public dataset with a usage range of 1 meter and by 17 percent (from a mean error of 2.22 degrees to 1.85 degrees) on a public dataset with a usage range of 2 meters.
引用
收藏
页码:166460 / 166471
页数:12
相关论文
共 50 条
  • [21] 3D Eye Model-Based Gaze Estimation from A Depth Sensor
    Zhou, Xiaolong
    Cai, Haibin
    Shao, Zhanpeng
    Yu, Hui
    Liu, Honghai
    2016 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (ROBIO), 2016, : 369 - 374
  • [22] 3D Gaze Estimation for Head-Mounted Devices based on Visual Saliency
    Liu, Meng
    Li, You Fu
    Liu, Hai
    2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, : 10611 - 10616
  • [23] Eye Gaze Based 3D Triangulation for Robotic Bionic Eyes
    Fan, Di
    Liu, Yanyang
    Chen, Xiaopeng
    Meng, Fei
    Liu, Xilong
    Ullah, Zakir
    Cheng, Wei
    Liu, Yunhui
    Huang, Qiang
    SENSORS, 2020, 20 (18) : 1 - 24
  • [24] 3D Hand Pose Estimation Using Synthetic Data and Weakly Labeled RGB Images
    Cai, Yujun
    Ge, Liuhao
    Cai, Jianfei
    Thalmann, Nadia Magnenat
    Yuan, Junsong
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (11) : 3739 - 3753
  • [25] 3D gaze estimation in the scene volume with a head-mounted eye tracker
    Elmadjian, Carlos
    Shukla, Pushkar
    Tula, Antonio Diaz
    Morimoto, Carlos H.
    COMMUNICATION BY GAZE INTERACTION (COGAIN 2018), 2018,
  • [26] TSG-net: a residual-based informing network for 3D Gaze estimation
    Li, Jianjun
    Fei, Jialuo
    Cheng, Shichao
    Tang, Zheng
    Hui, Guobao
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (03) : 3647 - 3662
  • [27] 3D Spectrum Mapping Based on ROI-Driven UAV Deployment
    Wu, Qihui
    Shen, Feng
    Wang, Zheng
    Ding, Guoru
    IEEE NETWORK, 2020, 34 (05): : 24 - 31
  • [28] Sensor Pose Estimation and 3D Mapping for Crane Operations Using Sensors Attached to the Crane Boom
    Ul Hassan, Mahmood
    Miura, Jun
    IEEE ACCESS, 2023, 11 : 90298 - 90308
  • [29] A Hybrid Approach to 3D Shape Estimation of Catheters Using Ultrasound Images
    Abdulhafiz, Ibrahim
    Janabi-Sharifi, Farrokh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (04) : 1912 - 1919
  • [30] Deformable Linear Objects 3D Shape Estimation and Tracking From Multiple 2D Views
    Caporali, Alessio
    Galassi, Kevin
    Palli, Gianluca
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (06) : 3851 - 3858