LiVRSono - Virtual Reality Training with Haptics for Intraoperative Ultrasound

被引:3
作者
Allgaier, Mareen [1 ]
Huettl, Florentine [2 ]
Hanke, Laura Isabel [2 ]
Lang, Hauke [2 ]
Huber, Tobias [2 ]
Preim, Bernhard [1 ]
Saalfeld, Sylvia [1 ]
Hansen, Christian [1 ]
机构
[1] Otto von Guericke Univ, Magdeburg, Germany
[2] Univ Med Ctr, Mainz, Germany
来源
2023 IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY, ISMAR | 2023年
关键词
Applied computing; Life and medical science; Health informatics; Human-centered computing; Human computer interaction (HCI); Interaction paradigms; Virtual reality; Interaction devices; Haptic devices; SIMULATION; LIVER; US;
D O I
10.1109/ISMAR59233.2023.00114
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
One of the biggest challenges in using ultrasound (US) is learning to create a spatial mental model of the interior of the scanned object based on the US image and the probe position. As intraoperative ultrasound (IOUS) cannot be easily trained on patients, we present LiVRSono, an immersive VR application to train this skill. The immersive environment, including an US simulation with patient-specific data as well as haptics to support hand-eye coordination, provides a realistic setting. Four clinically relevant training scenarios were identified based on the described learning goal and the workflow of IOUS for liver. The realism of the setting and the training scenarios were evaluated with eleven physicians, of which six participants are experts in IOUS for liver and five participants are potential users of the training system. The setting, handling of the US probe, and US image were considered realistic enough for the learning goal. Regarding the haptic feedback, a limitation is the restricted workspace of the input device. Three of the four training scenarios were rated as meaningful and effective. A pilot study regarding learning outcome shows positive results, especially with respect to confidence and perceived competence. Besides the drawbacks of the input device, our training system provides a realistic learning environment with meaningful scenarios to train the creation of a mental 3D model when performing IOUS. We also identified important improvements to the training scenarios to further enhance the training experience.
引用
收藏
页码:980 / 989
页数:10
相关论文
共 51 条
[1]   Ultrasound scanning techniques [J].
Adams, Reid B. .
SURGERY OPEN SCIENCE, 2022, 10 :182-207
[2]  
Al-Memar Maya, 2017, Australas J Ultrasound Med, V20, P97, DOI 10.1002/ajum.12052
[3]   A comparison of input devices for precise interaction tasks in VR-based surgical planning and training [J].
Allgaier, Mareen ;
Chheang, Vuthea ;
Saalfeld, Patrick ;
Apilla, Vikram ;
Huber, Tobias ;
Huettl, Florentine ;
Neyazi, Belal ;
Sandalcioglu, I. Erol ;
Hansen, Christian ;
Preim, Bernhard ;
Saalfeld, Sylvia .
COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 145
[4]   A Real-time Ultrasound Rendering with Model-based Tissue Deformation for Needle Insertion [J].
Barnouin, Charles ;
Zara, Florence ;
Jaillet, Fabrice .
PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 1: GRAPP, 2020, :235-246
[5]  
Bublak T., 2022, PROC MENSCH COMPUTER, P600, DOI [10.1145/3543758.3547516, DOI 10.1145/3543758.3547516]
[6]   Real-Time GPU-Based Ultrasound Simulation Using Deformable Mesh Models [J].
Buerger, Benny ;
Bettinghausen, Sascha ;
Raedle, Matthias ;
Hesser, Juergen .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2013, 32 (03) :609-618
[7]  
Byl B., 2018, P IEEE 6 INT C SERIO, P1, DOI 10.1109/SeGAH.2018.8401365
[8]   Consensus guidelines for validation of virtual reality surgical simulators [J].
Carter, FJ ;
Schijven, MP ;
Aggarwal, R ;
Grantcharov, T ;
Francis, NK ;
Hanna, GB ;
Jakimowicz, JJ .
SURGICAL ENDOSCOPY AND OTHER INTERVENTIONAL TECHNIQUES, 2005, 19 (12) :1523-1532
[9]  
d'Aulignac D., 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289), P727, DOI 10.1109/IROS.1999.812766
[10]   A Fast Convolution-Based Methodology to Simulate 2-D/3-D Cardiac Ultrasound Images [J].
Gao, Hang ;
Choi, Hon Fai ;
Claus, Piet ;
Boonen, Steven ;
Jaecques, Siegfried ;
van Lenthe, G. Harry ;
Van der Perre, Georges ;
Lauriks, Walter ;
D'hooge, Jan .
IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2009, 56 (02) :404-409