Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels

被引：210

作者：

Pratt P. ^{[1
]}

Ives M. ^{[2
]}

Lawton G. ^{[2
]}

Simmons J. ^{[2
]}

Radev N. ^{[3
]}

Spyropoulou L. ^{[4
]}

Amiras D. ^{[5
]}

机构：

[1] Department of Surgery and Cancer, Imperial College London, London

[2] Department of Plastic and Reconstructive Surgery, Imperial College Healthcare NHS Trust, London

[3] Hamlyn Centre for Medical Robotics, Imperial College London, London

[4] Imperial College School of Medicine, Imperial College London, London

[5] Department of Radiology, Imperial College Healthcare NHS Trust, London

来源：

European Radiology Experimental | / 2卷 / 1期

关键词：

Augmented reality; Computed tomography; HoloLens; Three-dimensional (3D) reconstruction; Vascular pedicle flap;

D O I：

10.1186/s41747-017-0033-2

中图分类号：

学科分类号：

摘要：

Precision and planning are key to reconstructive surgery. Augmented reality (AR) can bring the information within preoperative computed tomography angiography (CTA) imaging to life, allowing the surgeon to ‘see through’ the patient’s skin and appreciate the underlying anatomy without making a single incision. This work has demonstrated that AR can assist the accurate identification, dissection and execution of vascular pedunculated flaps during reconstructive surgery. Separate volumes of osseous, vascular, skin, soft tissue structures and relevant vascular perforators were delineated from preoperative CTA scans to generate three-dimensional images using two complementary segmentation software packages. These were converted to polygonal models and rendered by means of a custom application within the HoloLens™ stereo head-mounted display. Intraoperatively, the models were registered manually to their respective subjects by the operating surgeon using a combination of tracked hand gestures and voice commands; AR was used to aid navigation and accurate dissection. Identification of the subsurface location of vascular perforators through AR overlay was compared to the positions obtained by audible Doppler ultrasound. Through a preliminary HoloLens-assisted case series, the operating surgeon was able to demonstrate precise and efficient localisation of perforating vessels. © 2018, The Author(s).

引用

共 21 条

[1]

Gomez-Cia T., Gacto-Sanchez P., Sicilia D., Et al., The virtual reality tool VirSSPA in planning DIEP microsurgical breast reconstruction, Int J Comput Assist Radiol Surg, 4, pp. 375-382, (2009)

[2]

Gacto-Sanchez P., Sicilia-Castro D., Gomez-Cia T., Et al., Use of a three-dimensional virtual reality model for preoperative imaging in DIEP flap breast reconstruction, J Surg Res, 162, pp. 140-147, (2010)

[3]

Hummelink S., Verhulst A., Maal T., Hoogeveen Y., Schultze Kool L., Ulrich D., An innovative method of planning and displaying flap volume in DIEP flap breast reconstructions, J Plast Reconstr Aesthetic Surg, 70, pp. 871-875, (2017)

[4]

Hummelink S., Schultze Kool L., Ulrich D., Displaying inguinal lymph nodes before transplantation in a deep inferior epigastric perforator flap breast reconstruction using an innovative projection method, J Plast Reconstr Aesthetic Surg, 69, pp. 376-380, (2016)

[5]

Rodrigues D., Jain A., Rick S., Shangley L., Suresh P., Weibel N., Exploring mixed reality in specialized surgical environments, Proceedings of the ACM-CHI Conference on Human Factors in Computing Systems, pp. 2591-2598, (2017)

[6]

Cui N., Kharel P., Gruev V., Augmented reality with Microsoft HoloLens holograms for near infrared fluorescence based image guided surgery, Proc SPIE, 10049, pp. 1-6, (2017)

[7]

Masia J., Kosutic D., Clavero J., Larranaga J., Vives L., Pons G., Preoperative computed tomographic angiogram for deep inferior epigastric artery perforator flap breast reconstruction, J Reconstr Microsurg, 26, pp. 21-28, (2009)

[8]

Piorkowski J., DeRosier L., Nickerson P., Fix R., Preoperative computed tomography angiogram to predict patients with favorable anatomy for superficial inferior epigastric artery flap breast reconstruction, Ann Plast Surg, 66, pp. 534-536, (2011)

[9]

Teunis T., Heerma van Voss M., Kon M., van Maurik J., CT-angiography prior to DIEP flap breast reconstruction: A systematic review and meta-analysis, Microsurgery, 33, pp. 496-502, (2013)

[10]

Klasson S., Svensson H., Malm K., Wasselius J., Velander P., Preoperative CT angiography versus Doppler ultrasound mapping of abdominal perforator in DIEP breast reconstructions: A randomized prospective study, J Plast Reconstr Aesthetic Surg, 68, pp. 782-786, (2015)

← 1 2 3 →