Evaluating User Experience and Data Quality in Gamified Data Collection for Appearance-Based Gaze Estimation

被引:1
作者
Yue, Mingtao [1 ]
Sayuda, Tomomi [1 ]
Pennington, Miles [1 ]
Sugano, Yusuke [1 ]
机构
[1] Univ Tokyo, Inst Ind Sci, Tokyo, Japan
关键词
Gamification; gaze estimation; computer vision; machine learning;
D O I
10.1080/10447318.2024.2399873
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Appearance-based gaze estimation, which uses only a regular camera to estimate human gaze, is important in various application fields. While the technique faces data bias issues, data collection protocol is often demanding, and collecting data from a wide range of participants is difficult. It is an important challenge to design opportunities that allow a diverse range of people to participate while ensuring the quality of the training data. To tackle this challenge, we introduce a novel gamified approach for collecting training data. In this game, two players communicate words via eye gaze through a transparent letter board. Images captured during gameplay serve as valuable training data for gaze estimation models. The game is designed as a physical installation that involves communication between players, and it is expected to attract the interest of diverse participants. We assess the game's significance on data quality and user experience through a comparative user study. Gamification; gaze estimation; machine learning
引用
收藏
页码:7549 / 7565
页数:17
相关论文
共 62 条
[1]  
[Anonymous], 2004, P SIGCHI C HUM FACT, DOI [DOI 10.1145/985692.985733, 10.1145/985692.985733]
[2]   Combining Gaze Estimation and Optical Flow for Pursuits Interaction [J].
Bace, Mihai ;
Becker, Vincent ;
Wang, Chenyang ;
Bulling, Andreas .
ETRA'20 FULL PAPERS: ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, 2020,
[3]   Peripheral interaction: characteristics and considerations [J].
Bakker, Saskia ;
van den Hoven, Elise ;
Eggen, Berry .
PERSONAL AND UBIQUITOUS COMPUTING, 2015, 19 (01) :239-254
[4]  
Bazarevsky Valentin, 2019, P CVPR WORKSH COMP V
[5]  
Bowser A., 2013, P 1 INT C GAM DES RE, P18, DOI DOI 10.1145/2583008.2583011
[6]  
Bradski G, 2000, DR DOBBS J, V25, P120
[7]  
Bragg Danielle, 2021, CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, DOI 10.1145/3411764.3445416
[8]   How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks) [J].
Bulat, Adrian ;
Tzimiropoulos, Georgios .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1021-1030
[9]   Appearance-Based Gaze Estimation With Deep Learning: A Review and Benchmark [J].
Cheng, Yihua ;
Wang, Haofei ;
Bao, Yiwei ;
Lu, Feng .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) :7509-7528
[10]   Gaze Estimation using Transformer [J].
Cheng, Yihua ;
Lu, Feng .
2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, :3341-3347