Towards gaze-based prediction of the intent to interact in virtual reality

被引:44
作者
David-John, Brendan [1 ]
Peacock, Candace E. [1 ]
Zhang, Ting [1 ]
Murdison, T. Scott [2 ]
Benko, Hrvoje [1 ]
Jonker, Tanya R. [1 ]
机构
[1] Facebook Real Labs Res, Redmond, WA 98052 USA
[2] Facebook Real Labs, Redmond, WA USA
来源
ACM SYMPOSIUM ON EYE TRACKING RESEARCH AND APPLICATIONS, ETRA 2021 | 2021年
关键词
intent prediction; eye tracking; mixed reality; virtual reality; interaction; EYE-MOVEMENTS; USER INTERFACES;
D O I
10.1145/3448018.3458008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the increasing frequency of eye tracking in consumer products, including head-mounted augmented and virtual reality displays, gaze-based models have the potential to predict user intent and unlock intuitive new interaction schemes. In the present work, we explored whether gaze dynamics can predict when a user intends to interact with the real or digital world, which could be used to develop predictive interfaces for low-effort input. Eye-tracking data were collected from 15 participants performing an item-selection task in virtual reality. Using logistic regression, we demonstrated successful prediction of the onset of item selection. The most prevalent predictive features in the model were gaze velocity, ambient/focal attention, and saccade dynamics, demonstrating that gaze features typically used to characterize visual attention can be applied to model interaction intent. In the future, these types of models can be used to infer user's near-term interaction goals and drive ultra-low-friction predictive interfaces.
引用
收藏
页数:7
相关论文
共 44 条
[11]   Effects of aging on eye movements in the real world [J].
Dowiasch, Stefan ;
Marx, Svenja ;
Einhaeuser, Wolfgang ;
Bremmer, Frank .
FRONTIERS IN HUMAN NEUROSCIENCE, 2015, 9
[12]   Computational Visual Attention Systems and Their Cognitive Foundations: A Survey [J].
Frintrop, Simone ;
Rome, Erich ;
Christensen, Henrik I. .
ACM TRANSACTIONS ON APPLIED PERCEPTION, 2010, 7 (01)
[13]   Learning Cooperative Personalized Policies from Gaze Data [J].
Gebhardt, Christoph ;
Hecox, Brian ;
van Opheusden, Bas ;
Wigdor, Daniel ;
Hillis, James ;
Hilliges, Otmar ;
Benko, Hrvoje .
PROCEEDINGS OF THE 32ND ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY (UIST 2019), 2019, :197-208
[14]   A score level fusion method for eye movement biometrics [J].
George, Anjith ;
Routray, Aurobinda .
PATTERN RECOGNITION LETTERS, 2016, 82 :207-215
[15]  
Gingerich M, 2015, AAAI CONF ARTIF INTE, P1728
[16]   Eye movements in natural behavior [J].
Hayhoe, M ;
Ballard, D .
TRENDS IN COGNITIVE SCIENCES, 2005, 9 (04) :188-194
[17]   Modeling Task Control of Eye Movements [J].
Hayhoe, Mary ;
Ballard, Dana .
CURRENT BIOLOGY, 2014, 24 (13) :R622-R628
[18]   Control of gaze in natural environments: effects of rewards and costs, uncertainty and memory in target selection [J].
Hayhoe, Mary M. ;
Matthis, Jonathan Samir .
INTERFACE FOCUS, 2018, 8 (04)
[19]   Predicting Cognitive State from Eye Movements [J].
Henderson, John M. ;
Shinkareva, Svetlana V. ;
Wang, Jing ;
Luke, Steven G. ;
Olejarczyk, Jenn .
PLOS ONE, 2013, 8 (05)
[20]   Consumed Endurance: A Metric to Quantify Arm Fatigue of Mid-Air Interactions [J].
Hincapie-Ramos, Juan David ;
Guo, Xiang ;
Moghadasian, Paymahn ;
Irani, Pourang .
32ND ANNUAL ACM CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2014), 2014, :1063-1072