Integrating Eye-Tracking to Augmented Reality System for Surgical Training

被引：0
作者：
Shang Lu
Yerly Paola Sanchez Perdomo
Xianta Jiang
Bin Zheng
机构：
[1] University of Alberta,Multimedia Research Center, Department of Computing Science
[2] University of Alberta,Surgical Simulation Research Lab, Department of Surgery
来源：
Journal of Medical Systems | 2020年 / 44卷
关键词：
Augmented reality; Eye tracking; Calibration; Simulation; Surgical training;
D O I：
暂无
中图分类号：
学科分类号：
摘要：
Augmented Reality has been utilized for surgical training. During the implementation, displaying instructional information at the right moment is critical for skill acquisition. We built a new surgical training platform combining augmented reality system (HoloLens, Microsoft) with an eye-tracker (Pupil labs, Germany). Our goal is to detect the moments of performance difficulty using the integrated eye-tracker so that the system could display instructions at the precise moment when the user is seeking instructional information during a surgical skill practice in simulation. In the paper, we describe the system design, system calibration and data transferring between these devices.
引用
收藏
相关论文
共 67 条
[1]  
Barsom E(2016)Systematic review on the effectiveness of augmented reality applications in medical training Surgical endoscopy 30 4174-4183
[2]  
Graafland M(2017)The status of augmented reality in laparoscopic surgery as of 2016 Medical image analysis 37 66-90
[3]  
Schijven M(2016)Augmented reality assisted surgery: a urologic training tool Asian journal of andrology 18 732-573
[4]  
Bernhardt S(2016)A novel eye-gaze-controlled wheelchair system for navigating unknown environments: Case study with a person with als IEEE Access 4 558-11
[5]  
Nicolau SA(2017)Retinal 3d: augmented reality near-eye display via pupil-tracked light field projection on retina ACM Transactions on Graphics (TOG) 36 190-182
[6]  
Soler L(2015)Pupil responses to continuous aiming movements International Journal of Human-Computer Studies 83 1-F84
[7]  
Doignon C(2013)Context-aware augmented reality in laparoscopic surgery Computerized Medical Imaging and Graphics 37 174-14
[8]  
Dickey RM(2018)In the blink of an eye: leveraging blink-induced suppression for imperceptible position and orientation redirection in virtual reality ACM Transactions on Graphics (TOG) 37 66-4
[9]  
Srikishen N(2018)Analysis of neonatal resuscitation using eye tracking: a pilot study Archives of Disease in Childhood-Fetal and Neonatal Edition 103 F82-635
[10]  
Lipshultz LI(2007)Action and workflow-driven augmented reality for computer-aided medical procedures IEEE Computer Graphics and Applications 27 10-undefined
1234567