Use of mixed reality for surgery planning: Assessment and development workflow

被引：38

作者：

Kumar R.P. ^{[1
]}

Pelanis E. ^{[1
,2
]}

Bugge R. ^{[1
,3
]}

Brun H. ^{[1
,4
]}

Palomar R. ^{[1
,5
]}

Aghayan D.L. ^{[1
,2
,6
]}

Fretland Å.A. ^{[1
,2
,7
]}

Edwin B. ^{[1
,2
,7
]}

Elle O.J. ^{[1
,8
]}

机构：

[1] The Intervention Centre, Oslo University Hospital, Sognsvannsveien 20, Oslo

[2] Institute of Clinical Medicine, University of Oslo, Kirkeveien 166, Oslo

[3] Department of Diagnostic Physics, Oslo University Hospital, Sognsvannsvn 20, Oslo

[4] Department for Pediatric Cardiology, Oslo University Hospital, Sognsvannsvn 20, Oslo

[5] Department of Computer Science, NTNU, Teknologiveien 22, Gjøvik

[6] Department of Surgery N1, Yerevan State Medical University, Yerevan

[7] Department of Hepatopancreatobiliary Surgery, Oslo University Hospital, Sognsvannsveien 20, Oslo

[8] Department of Informatics, University of Oslo, Gaustadallèen 23 B, Oslo

来源：

Journal of Biomedical Informatics: X | 2020年 / 8卷

基金：

欧盟地平线“2020”;

关键词：

Mixed reality; Planning; Segmentation; Surgery;

D O I：

10.1016/j.yjbinx.2020.100077

中图分类号：

学科分类号：

摘要：

Meticulous preoperative planning is an important part of any surgery to achieve high levels of precision and avoid complications. Conventional medical 2D images and their corresponding three-dimensional (3D) reconstructions are the main components of an efficient planning system. However, these systems still use flat screens for visualisation of 3D information, thus losing depth information which is crucial for 3D spatial understanding. Currently, cutting-edge mixed reality systems have shown to be a worthy alternative to provide 3D information to clinicians. In this work, we describe development details of the different steps in the workflow for the clinical use of mixed reality, including results from a qualitative user evaluation and clinical use-cases in laparoscopic liver surgery and heart surgery. Our findings indicate a very high general acceptance of mixed reality devices with our applications and they were consistently rated high for device, visualisation and interaction areas in our questionnaire. Furthermore, our clinical use-cases demonstrate that the surgeons perceived the HoloLens to be useful, recommendable to other surgeons and also provided a definitive answer at a multi-disciplinary team meeting. © 2020 The Authors

引用

共 25 条

[1] Al Janabi H.F., Aydin A., Palaneer S., Macchione N., Al-Jabir A., Khan M.S., Dasgupta P., Ahmed K., Effectiveness of the HoloLens mixed-reality headset in minimally invasive surgery: a simulation-based feasibility study, Surg. Endosc., 34, pp. 1143-1149, (2019)
[2] Moghbel M., Mashohor S., Mahmud R., Saripan M.I.B., Review of liver segmentation and computer assisted detection/diagnosis methods in computed tomography, Artif. Intell. Rev., 50, 4, pp. 497-537, (2018)
[3] Kang D., Woo J., Kuo C.C.J., Slomka P.J., Dey D., Germano G., Heart chambers and whole heart segmentation techniques: review, J. Electron. Imaging, 21, 1, (2012)
[4] Sauer I.M., Queisner M., Tang P., Moosburner S., Hoepfner O., Horner R., Lohmann R., Pratschke J., Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases, Ann. Surg., 266, 5, (2017)
[5] Pelanis E., Kumar R.P., Aghayan D.L., Palomar R., Fretland A.A., Brun H., Elle O.J., Edwin B., Use of mixed reality for improved spatial understanding of liver anatomy, Minimally Invasive Therapy Allied Technol., pp. 1-7, (2019)
[6] Brun H., Bugge R.A.B., Suther L.K.R., Birkeland S., Kumar R., Pelanis E., Elle O.J., Mixed reality holograms for heart surgery planning: first user experience in congenital heart disease, Eur. Heart J.- Cardiovasc. Imag., 20, 8, pp. 883-888, (2019)
[7] Gasques Rodrigues D., Jain A., Rick S.R., Shangley L., Suresh P., Weibel N., Exploring Mixed Reality in Specialized Surgical Environments, in, Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA ’17, pp. 2591-2598, (2017)
[8] Iqbal M.H., Aydin A., Brunckhorst O., Dasgupta P., Ahmed K., A review of wearable technology in medicine, J. R. Soc. Med., 109, 10, pp. 372-380, (2016)
[9] Pratt P., Ives M., Lawton G., Simmons J., Radev N., Spyropoulou L., Amiras D., Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3d vascular models with perforating vessels, Eur. Radiol. Exp., 2, (2018)
[10] Perkins S.L., Lin M.A., Srinivasan S., Wheeler A.J., Hargreaves B.A., Daniel B.L., A Mixed-Reality System for Breast Surgical Planning, pp. 269-274, (2017)

← 1 2 3 →