Immersive Learning Experiences for Surgical Procedures

被引:4
作者
Cha, Young-Woon [1 ]
Dou, Mingsong [3 ]
Chabra, Rohan [1 ]
Menozzi, Federico [1 ]
State, Andrei [1 ,4 ]
Wallen, Eric [2 ]
Fuchs, Henry [1 ]
机构
[1] Univ North Carolina Chapel Hill, Dept Comp Sci, Chapel Hill, NC 27599 USA
[2] Univ North Carolina Chapel Hill, Dept Urol, Chapel Hill, NC USA
[3] Microsoft Res, Redmond, WA USA
[4] InnerOpt Technol Inc, Hillsborough, NC USA
来源
MEDICINE MEETS VIRTUAL REALITY 22 | 2016年 / 220卷
基金
新加坡国家研究基金会;
关键词
3D Reconstruction; Immersive Experience; Virtual Reality; Surgical Procedures; Immersive Environment;
D O I
10.3233/978-1-61499-625-5-55
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This paper introduces a computer-based system that is designed to record a surgical procedure with multiple depth cameras and reconstruct in three dimensions the dynamic geometry of the actions and events that occur during the procedure. The resulting 3D-plus-time data takes the form of dynamic, textured geometry and can be immersively examined at a later time; equipped with a Virtual Reality headset such as Oculus Rift DK2, a user can walk around the reconstruction of the procedure room while controlling playback of the recorded surgical procedure with simple VCR-like controls (play, pause, rewind, fast forward). The reconstruction can be annotated in space and time to provide more information of the scene to users. We expect such a system to be useful in applications such as training of medical students and nurses.
引用
收藏
页码:55 / 62
页数:8
相关论文
共 21 条
  • [1] SLIC Superpixels Compared to State-of-the-Art Superpixel Methods
    Achanta, Radhakrishna
    Shaji, Appu
    Smith, Kevin
    Lucchi, Aurelien
    Fua, Pascal
    Suesstrunk, Sabine
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) : 2274 - 2281
  • [2] Alexandrova Ivelina V, 2012, Stud Health Technol Inform, V173, P16
  • [3] Curless B., 1996, Computer Graphics Proceedings. SIGGRAPH '96, P303, DOI 10.1145/237170.237269
  • [4] CliniSpace TM: A Multiperson 3D Online Immersive Training Environment Accessible through a Browser
    Dev, Parvati
    Heinrichs, W. LeRoy
    Youngblood, Patricia
    [J]. MEDICINE MEETS VIRTUAL REALITY 18, 2011, 163 : 173 - 179
  • [5] Multi-View Object Segmentation in Space and Time
    Djelouah, Abdelaziz
    Franco, Jean-Sebastien
    Boyer, Edmond
    Le Clerc, Francois
    Perez, Patrick
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 2640 - 2647
  • [6] Dou M., 2012, Asian Conference on Computer Vision, P94
  • [7] Dou MS, 2015, PROC CVPR IEEE, P493, DOI 10.1109/CVPR.2015.7298647
  • [8] Dou MS, 2014, 2014 IEEE VIRTUAL REALITY (VR), P39, DOI 10.1109/VR.2014.6802048
  • [9] The forensic holodeck: an immersive display for forensic crime scene reconstructions
    Ebert, Lars C.
    Nguyen, Tuan T.
    Breitbeck, Robert
    Braun, Marcel
    Thali, Michael J.
    Ross, Steffen
    [J]. FORENSIC SCIENCE MEDICINE AND PATHOLOGY, 2014, 10 (04) : 623 - 626
  • [10] Ferracani A., 2014, P 2014 ACM INT WORKS, P27