Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display

被引:76
作者
Qian, Long [1 ,4 ]
Barthel, Alexander [1 ,2 ]
Johnson, Alex [3 ]
Osgood, Greg [3 ]
Kazanzides, Peter [4 ]
Navab, Nassir [1 ,2 ]
Fuerst, Bernhard [1 ]
机构
[1] Johns Hopkins Univ, Comp Aided Med Procedures, Baltimore, MD 21218 USA
[2] Tech Univ Munich, Comp Aided Med Procedures, Munich, Germany
[3] Johns Hopkins Univ Hosp, Dept Orthopaed Surg, Baltimore, MD 21287 USA
[4] Johns Hopkins Univ, Lab Computat Sensing & Robot, Baltimore, MD 21218 USA
基金
美国国家卫生研究院;
关键词
Mixed reality; Intervention; Optical seethrough head-mounted display; User study; AUGMENTED REALITY; VIDEO SEE; MONITOR; PERFORMANCE; NAVIGATION;
D O I
10.1007/s11548-017-1564-y
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Optical see-through head-mounted displays (OST-HMD) feature an unhindered and instantaneous view of the surgery site and can enable a mixed reality experience for surgeons during procedures. In this paper, we present a systematic approach to identify the criteria for evaluation of OST-HMD technologies for specific clinical scenarios, which benefit from using an object-anchored 2D-display visualizing medical information. Criteria for evaluating the performance of OST-HMDs for visualization of medical information and its usage are identified and proposed. These include text readability, contrast perception, task load, frame rate, and system lag. We choose to compare three commercially available OST-HMDs, which are representatives of currently available head-mounted display technologies. A multi-user study and an offline experiment are conducted to evaluate their performance. Statistical analysis demonstrates that Microsoft HoloLens performs best among the three tested OST-HMDs, in terms of contrast perception, task load, and frame rate, while ODG R-7 offers similar text readability. The integration of indoor localization and fiducial tracking on the HoloLens provides significantly less system lag in a relatively motionless scenario. With ever more OST-HMDs appearing on the market, the proposed criteria could be used in the evaluation of their suitability for mixed reality surgical intervention. Currently, Microsoft HoloLens may be more suitable than ODG R-7 and Epson Moverio BT-200 for clinical usability in terms of the evaluated criteria. To the best of our knowledge, this is the first paper that presents a methodology and conducts experiments to evaluate and compare OST-HMDs for their use as object-anchored 2D-display during interventions.
引用
收藏
页码:901 / 910
页数:10
相关论文
共 42 条
  • [1] A novel 3D guidance system using augmented reality for percutaneous vertebroplasty
    Abe, Yuichiro
    Sato, Shigenobu
    Kato, Koji
    Hyakumachi, Takahiko
    Yanagibashi, Yasushi
    Ito, Manabu
    Abumi, Kuniyoshi
    [J]. JOURNAL OF NEUROSURGERY-SPINE, 2013, 19 (04) : 492 - 501
  • [2] [Anonymous], 2015, EURASIP J WIRELESS C
  • [3] [Anonymous], 2008, SPRINGER HDB ROBOTIC, DOI DOI 10.1007/978-3-540-30301-5_38
  • [4] Armstrong David G, 2014, J Diabetes Sci Technol, V8, P951, DOI 10.1177/1932296814535561
  • [5] Azimi E, 2012, IEEE VIRTUAL REALITY CONFERENCE 2012 PROCEEDINGS, P123, DOI 10.1109/VR.2012.6180913
  • [6] Augmented reality as an aid in maxillofacial surgery: Validation of a wearable system allowing maxillary repositioning
    Badiali, Giovanni
    Ferrari, Vincenzo
    Cutolo, Fabrizio
    Freschi, Cinzia
    Caramella, Davide
    Bianchi, Alberto
    Marchetti, Claudio
    [J]. JOURNAL OF CRANIO-MAXILLOFACIAL SURGERY, 2014, 42 (08) : 1970 - 1976
  • [7] Merging virtual objects with the real world: seeing ultrasound imagery within the patient
    Bajura, Michael
    Fuchs, Henry
    Ohbuchi, Ryutarou
    [J]. Computer Graphics (ACM), 1992, 26 (02): : 203 - 210
  • [8] Bichlmeier C, 2008, INT SYM MIX AUGMENT, P165, DOI 10.1109/ISMAR.2008.4637348
  • [9] Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display
    Chen, Xiaojun
    Xu, Lu
    Wang, Yiping
    Wang, Huixiang
    Wang, Fang
    Zeng, Xiangsen
    Wang, Qiugen
    Egger, Jan
    [J]. JOURNAL OF BIOMEDICAL INFORMATICS, 2015, 55 : 124 - 131
  • [10] Cutolo F, 2014, INT SYM MIX AUGMENT, P393