Gaze-based attention network analysis in a virtual reality classroom

被引:3
作者
Stark, Philipp [1 ]
Hasenbein, Lisa [1 ]
Kasneci, Enkelejda [2 ]
Goellner, Richard [1 ,3 ]
机构
[1] Univ Tubingen, Hector Res Inst, Europastr 6, D-72072 Tubingen, Germany
[2] Tech Univ Munich, Chair Human Ctr Technol Learning, Arcisstr 21, D-80333 Munich, Germany
[3] Univ Regensburg, Inst Educ Sci, Univ Str 31, D-93053 Regensburg, Germany
关键词
Network analysis; Eye tracking; Virtual reality; Gaze-ray casting; Visual attention; Graph theory; CENTRALITY; FIXATIONS;
D O I
10.1016/j.mex.2024.102662
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
This article provides a step-by-step guideline for measuring and analyzing visual attention in 3D virtual reality (VR) environments based on eye -tracking data. We propose a solution to the challenges of obtaining relevant eye -tracking information in a dynamic 3D virtual environment and calculating interpretable indicators of learning and social behavior. With a method called "gazeray casting," we simulated 3D -gaze movements to obtain information about the gazed objects. This information was used to create graphical models of visual attention, establishing attention networks. These networks represented participants' gaze transitions between different entities in the VR environment over time. Measures of centrality, distribution, and interconnectedness of the networks were calculated to describe the network structure. The measures, derived from graph theory, allowed for statistical inference testing and the interpretation of participants' visual attention in 3D VR environments. Our method provides useful insights when analyzing students' learning in a VR classroom, as reported in a corresponding evaluation article with N = 274 participants. center dot Guidelines on implementing gaze -ray casting in VR using the Unreal Engine and the HTC VIVE Pro Eye. center dot Creating gaze -based attention networks and analyzing their network structure. center dot Implementation tutorials and the Open Source software code are provided via OSF: https://osf.io/pxjrc/?view_only = 1b6da45eb93e4f9eb7a138697b941198 .
引用
收藏
页数:14
相关论文
共 64 条
[1]   Eye Tracking in Virtual Reality: a Broad Review of Applications and Challenges [J].
Adhanom, Isayas Berhe ;
MacNeilage, Paul ;
Folmer, Eelke .
VIRTUAL REALITY, 2023, 27 (02) :1481-1505
[2]  
Alghamdi N, 2019, INT J ADV COMPUT SC, V10, P60
[3]   Look together: analyzing gaze coordination with epistemic network analysis [J].
Andrist, Sean ;
Collier, Wesley ;
Gleicher, Michael ;
Mutlu, Bilge ;
Shaffer, David .
FRONTIERS IN PSYCHOLOGY, 2015, 6
[4]   Do students learn better when seated close to the teacher? A virtual classroom study considering individual levels of inattention and hyperactivity-impulsivity [J].
Blume, Friederike ;
Goellner, Richard ;
Moeller, Korbinian ;
Dresler, Thomas ;
Ehlis, Ann-Christine ;
Gawrilow, Caterina .
LEARNING AND INSTRUCTION, 2019, 61 :138-147
[5]   Centrality and network flow [J].
Borgatti, SP .
SOCIAL NETWORKS, 2005, 27 (01) :55-71
[6]   Exploiting Object-of-Interest Information to Understand Attention in VR Classrooms [J].
Bozkir, Efe ;
Stark, Philipp ;
Gao, Hong ;
Hasenbein, Lisa ;
Hahn, Jens-Uwe ;
Kasneci, Enkelejda ;
Goellner, Richard .
2021 IEEE VIRTUAL REALITY AND 3D USER INTERFACES (VR), 2021, :597-605
[7]  
Brandes U., 2005, NETWORK ANAL METHODO, V3418, DOI DOI 10.1007/B106453
[8]   A New Weighted Degree Centrality Measure: The Application in an Animal Disease Epidemic [J].
Candeloro, Luca ;
Savini, Lara ;
Conte, Annamaria .
PLOS ONE, 2016, 11 (11)
[9]   Eye Tracking in Virtual Reality [J].
Clay, Viviane ;
Koenig, Peter ;
Koenig, Sabine .
JOURNAL OF EYE MOVEMENT RESEARCH, 2019, 12 (01)
[10]   Scanpath modeling and classification with hidden Markov models [J].
Coutrot, Antoine ;
Hsiao, Janet H. ;
Chan, Antoni B. .
BEHAVIOR RESEARCH METHODS, 2018, 50 (01) :362-379