SUPREYES: SUPer Resolution for EYES Using Implicit Neural Representation Learning

被引:0
作者
Jiao, Chuhan [1 ]
Hu, Zhiming [1 ]
Bace, Mihai [1 ]
Bulling, Andreas [1 ]
机构
[1] Univ Stuttgart, Stuttgart, Germany
来源
PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, UIST 2023 | 2023年
基金
欧洲研究理事会; 瑞士国家科学基金会;
关键词
Gaze Data Super-resolution; Implicit Neural Representation; Up-sampling; GAZE TRACKING; BIOMETRICS;
D O I
10.1145/3586183.3606780
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce SUPREYES - a novel self-supervised method to increase the spatio-temporal resolution of gaze data recorded using low(er)-resolution eye trackers. Despite continuing advances in eye tracking technology, the vast majority of current eye trackers - particularly mobile ones and those integrated into mobile devices - suffer from low-resolution gaze data, thus fundamentally limiting their practical usefulness. SUPREYES learns a continuous implicit neural representation from low-resolution gaze data to up-sample the gaze data to arbitrary resolutions. We compare our method with commonly used interpolation methods on arbitrary scale super-resolution and demonstrate that SUPREYES outperforms these baselines by a significant margin. We also test on the sample downstream task of gaze-based user identification and show that our method improves the performance of original low-resolution gaze data and outperforms other baselines. These results are promising as they open up a new direction for increasing eye tracking fidelity as well as enabling new gaze-based applications without the need for new eye tracking equipment.
引用
收藏
页数:13
相关论文
共 82 条
[1]   One algorithm to rule them all? An evaluation and discussion of ten eye movement event-detection algorithms [J].
Andersson, Richard ;
Larsson, Linnea ;
Holmqvist, Kenneth ;
Stridh, Martin ;
Nystrom, Marcus .
BEHAVIOR RESEARCH METHODS, 2017, 49 (02) :616-637
[2]   Event-Based Near-Eye Gaze Tracking Beyond 10,000 Hz [J].
Angelopoulos, Anastasios N. ;
Martel, Julien N. P. ;
Kohli, Amit P. ;
Conradt, Jorg ;
Wetzstein, Gordon .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (05) :2577-2586
[3]  
[Anonymous], 2022, 2022 IEEE CVF C COMP, P2037
[4]   X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation [J].
Bemana, Mojtaba ;
Myszkowski, Karol ;
Seidel, Hans-Peter ;
Ritschel, Tobias .
ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06)
[5]   GazeCode: open-source software for manual mapping of mobile eye-tracking data [J].
Benjamins, Jeroen S. ;
Hessels, Roy S. ;
Hooge, Ignace T. C. .
2018 ACM SYMPOSIUM ON EYE TRACKING RESEARCH & APPLICATIONS (ETRA 2018), 2018,
[6]  
Blondel M, 2021, PR MACH LEARN RES, V130
[7]   Driver-Activity Recognition in the Context of Conditionally Autonomous Driving [J].
Braunagel, Christian ;
Stolzmann, Wolfgang ;
Kasneci, Enkelejda ;
Rosenstiel, Wolfgang .
2015 IEEE 18TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, 2015, :1652-1657
[8]   Ophthalmologic disorders and risk factors in children with autism spectrum disorder [J].
Chang, Melinda Y. ;
Gandhi, Nandini ;
O'Hara, Mary .
JOURNAL OF AAPOS, 2019, 23 (06) :337-339
[9]   Interpolation of wind-induced pressure time series with an artificial neural network [J].
Chen, Y ;
Kopp, GA ;
Surry, D .
JOURNAL OF WIND ENGINEERING AND INDUSTRIAL AERODYNAMICS, 2002, 90 (06) :589-615
[10]   Learning Continuous Image Representation with Local Implicit Image Function [J].
Chen, Yinbo ;
Liu, Sifei ;
Wang, Xiaolong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8624-8634