How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens

被引:111
作者
Condino, Sara [1 ,2 ]
Turini, Giuseppe [3 ]
Parchi, Paolo D. [1 ,4 ]
Viglialoro, Rosanna M. [1 ]
Piolanti, Nicola [4 ]
Gesi, Marco [5 ,6 ]
Ferrari, Mauro [1 ]
Ferrari, Vincenzo [1 ,2 ]
机构
[1] Univ Pisa, Dept Translat Res & New Surg & Med Technol, EndoCAS Ctr, I-56124 Pisa, PI, Italy
[2] Univ Pisa, Dept Informat Engn, I-56124 Pisa, PI, Italy
[3] Kettering Univ, Dept Comp Sci Dept, Flint, MI 48504 USA
[4] Univ Pisa, Dept Translat Res & New Surg & Med Technol, Orthopaed & Traumatol Div 1, I-56124 Pisa, PI, Italy
[5] Univ Pisa, Dept Translat Res & New Surg & Med Technol, I-56124 Pisa, PI, Italy
[6] Univ Pisa, Ctr Rehabil Med Sport & Anat, I-56124 Pisa, PI, Italy
关键词
VERGENCE-ACCOMMODATION CONFLICT; MOUNTED DISPLAYS; FEMUR; TOOL;
D O I
10.1155/2018/5435097
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Orthopaedic simulators are popular in innovative surgical training programs, where trainees gain procedural experience in a safe and controlled environment. Recent studies suggest that an ideal simulator should combine haptic, visual, and audio technology to create an immersive training environment. This article explores the potentialities of mixed-reality using the HoloLens to develop a hybrid training system for orthopaedic open surgery. Hip arthroplasty, one of the most common orthopaedic procedures, was chosen as a benchmark to evaluate the proposed system. Patient-specific anatomical 3D models were extracted from a patient computed tomography to implement the virtual content and to fabricate the physical components of the simulator. Rapid prototyping was used to create synthetic bones. The Vuforia SDK was utilized to register virtual and physical contents. The Unity3D game engine was employed to develop the software allowing interactions with the virtual content using head movements, gestures, and voice commands. Quantitative tests were performed to estimate the accuracy of the system by evaluating the perceived position of augmented reality targets. Mean and maximum errors matched the requirements of the target application. Qualitative tests were carried out to evaluate workload and usability of the HoloLens for our orthopaedic simulator, considering visual and audio perception and interaction and ergonomics issues. The perceived overall workload was low, and the self-assessed performance was considered satisfactory. Visual and audio perception and gesture and voice interactions obtained a positive feedback. Postural discomfort and visual fatigue obtained a nonnegative evaluation for a simulation session of 40 minutes. These results encourage using mixed-reality to implement a hybrid simulator for orthopaedic open surgery. An optimal design of the simulation tasks and equipment setup is required to minimize the user discomfort. Future works will include Face Validity, Content Validity, and Construct Validity to complete the assessment of the hip arthroplasty simulator.
引用
收藏
页数:12
相关论文
共 44 条
  • [41] Viglialoro Rosanna M., 2016, 12th IASTED International Conference on Biomedical Engineering (BioMed 2016). Proceedings, P85, DOI 10.2316/P.2016.832-032
  • [42] Augmented Reality Simulator for Laparoscopic Cholecystectomy Training
    Viglialoro, Rosanna Maria
    Condino, Sara
    Gesi, Marco
    Ferrari, Mauro
    Ferrari, Vincenzo
    [J]. AUGMENTED AND VIRTUAL REALITY, AVR 2014, 2014, 8853 : 428 - 433
  • [43] Wolf Brian R, 2012, J Bone Joint Surg Am, V94, pe103, DOI 10.2106/JBJS.K.00011
  • [44] User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability
    Yushkevich, Paul A.
    Piven, Joseph
    Hazlett, Heather Cody
    Smith, Rachel Gimpel
    Ho, Sean
    Gee, James C.
    Gerig, Guido
    [J]. NEUROIMAGE, 2006, 31 (03) : 1116 - 1128