Immersive Learning Experiences for Surgical Procedures

被引：4

作者：

Cha, Young-Woon ^{[1
]}

Dou, Mingsong ^{[3
]}

Chabra, Rohan ^{[1
]}

Menozzi, Federico ^{[1
]}

State, Andrei ^{[1
,4
]}

Wallen, Eric ^{[2
]}

Fuchs, Henry ^{[1
]}

机构：

[1] Univ North Carolina Chapel Hill, Dept Comp Sci, Chapel Hill, NC 27599 USA

[2] Univ North Carolina Chapel Hill, Dept Urol, Chapel Hill, NC USA

[3] Microsoft Res, Redmond, WA USA

[4] InnerOpt Technol Inc, Hillsborough, NC USA

来源：

MEDICINE MEETS VIRTUAL REALITY 22 | 2016年 / 220卷

基金：

新加坡国家研究基金会;

关键词：

3D Reconstruction; Immersive Experience; Virtual Reality; Surgical Procedures; Immersive Environment;

D O I：

10.3233/978-1-61499-625-5-55

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

This paper introduces a computer-based system that is designed to record a surgical procedure with multiple depth cameras and reconstruct in three dimensions the dynamic geometry of the actions and events that occur during the procedure. The resulting 3D-plus-time data takes the form of dynamic, textured geometry and can be immersively examined at a later time; equipped with a Virtual Reality headset such as Oculus Rift DK2, a user can walk around the reconstruction of the procedure room while controlling playback of the recorded surgical procedure with simple VCR-like controls (play, pause, rewind, fast forward). The reconstruction can be annotated in space and time to provide more information of the scene to users. We expect such a system to be useful in applications such as training of medical students and nurses.

引用

页码：55 / 62

页数：8

共 21 条

[11] Immersive 3D Telepresence
Fuchs, Henry
State, Andrei
Bazin, Jean-Charles
[J]. COMPUTER, 2014, 47 (07) : 46 - 52
[12] Teleimmersive Environment for Remote Medical Collaboration
Kurillo, Gregorij
Bajcsy, Ruzena
Kreylos, Oliver
Rodriguez, Rodny
[J]. MEDICINE MEETS VIRTUAL REALITY 17 - NEXTMED: DESIGN FOR/THE WELL BEING, 2009, 142 : 148 - +
[13] Lin Qiufeng, 2013, SPIE MED IMAGING, V8673, P17
[14] Liu Y, 2014, 2014 INTERNATIONAL CONFERENCE ON AUDIO, LANGUAGE AND IMAGE PROCESSING (ICALIP), VOLS 1-2, P623, DOI 10.1109/ICALIP.2014.7009869
[15] Lorensen W., 1987, ACM TOG, V87, P163, DOI [DOI 10.1145/37401.37422, 10.1145/37401.37422]
[16] Newcombe RA, 2015, PROC CVPR IEEE, P343, DOI 10.1109/CVPR.2015.7298631
[17] KinectFusion: Real-Time Dense Surface Mapping and Tracking
Newcombe, Richard A.
Izadi, Shahram
Hilliges, Otmar
Molyneaux, David
Kim, David
Davison, Andrew J.
Kohli, Pushmeet
Shotton, Jamie
Hodges, Steve
Fitzgibbon, Andrew
[J]. 2011 10TH IEEE INTERNATIONAL SYMPOSIUM ON MIXED AND AUGMENTED REALITY (ISMAR), 2011, : 127 - 136
[18] Taneja A, 2011, IEEE I CONF COMP VIS, P2336, DOI 10.1109/ICCV.2011.6126515
[19] Ulusoy AO, 2014, LECT NOTES COMPUT SC, V8691, P31, DOI 10.1007/978-3-319-10578-9_3
[20] Immersive electronic books for surgical training
Welch, G
State, A
Ilie, A
Low, KL
Lastra, A
Cairns, B
Towles, H
Fuchs, H
[J]. IEEE MULTIMEDIA, 2005, 12 (03) : 22 - 35

← 1 2 3 →