Design of interactive augmented reality functions for robotic surgery and evaluation in dry-lab lymphadenectomy

被引：8

作者：

Forte, Maria-Paola ^{[1
]}

Gourishetti, Ravali ^{[1
]}

Javot, Bernard ^{[1
]}

Engler, Tobias ^{[2
]}

Gomez, Ernest D. ^{[3
]}

Kuchenbecker, Katherine J. ^{[1
]}

机构：

[1] Max Planck Inst Intelligent Syst, Hapt Intelligence Dept, D-70569 Stuttgart, Germany

[2] Tubingen Univ Hosp, Tubingen, Germany

[3] Harvard Med Sch, Beth Israel Deaconess Med Ctr, Boston, MA 02115 USA

来源：

INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY | 2022年 / 18卷 / 02期

关键词：

augmented reality; laparoscopic surgery; robotic surgery;

D O I：

10.1002/rcs.2351

中图分类号：

R61 [外科手术学];

学科分类号：

摘要：

Background: Augmented reality (AR) has been widely researched for use in healthcare. Prior AR for robot-assisted minimally invasive surgery has mainly focussed on superimposing preoperative three-dimensional (3D) images onto patient anatomy. This article presents alternative interactive AR tools for robotic surgery. Methods: We designed, built and evaluated four voice-controlled functions: viewing a live video of the operating room, viewing two-dimensional preoperative images, measuring 3D distances and warning about out-of-view instruments. This low-cost system was developed on a da Vinci Si, and it can be integrated into surgical robots equipped with a stereo camera and a stereo viewer. Results: Eight experienced surgeons performed dry-lab lymphadenectomies and reported that the functions improved the procedure. They particularly appreciated the possibility of accessing the patient's medical records on demand, measuring distances intraoperatively and interacting with the functions using voice commands. Conclusions: The positive evaluations garnered by these alternative AR functions and interaction methods provide support for further exploration.

引用

页数：17

共 38 条

[1] Augmented reality based real-time subcutaneous vein imaging system [J].

Ai, Danni ;

Yang, Jian ;

Fan, Jingfan ;

Zhao, Yitian ;

Song, Xianzheng ;

Shen, Jianbing ;

Shao, Ling ;

Wang, Yongtian .

BIOMEDICAL OPTICS EXPRESS, 2016, 7 (07) :2565-2585

[2]

Akinbiyi Takintope, 2006, Conf Proc IEEE Eng Med Biol Soc, V2006, P567

[3]

[Anonymous], 2019, POCKETSPHINX

[4] The status of augmented reality in laparoscopic surgery as of 2016 [J].

Bernhardt, Sylvain ;

Nicolau, Stephane A. ;

Soler, Luc ;

Doignon, Christophe .

MEDICAL IMAGE ANALYSIS, 2017, 37 :66-90

[5]

Bourke, 2011, PAPERS ARTICLES SEMI

[6] Evaluation of high-fidelity simulation as a training tool in transoral robotic surgery [J].

Bur, Andres M. ;

Gomez, Ernest D. ;

Newman, Jason G. ;

Weinstein, Gregory S. ;

O'Malley, Bert W., Jr. ;

Rassekh, Christopher H. ;

Kuchenbecker, Katherine J. .

LARYNGOSCOPE, 2017, 127 (12) :2790-2795

[7]

DiMaio S., 2016, US Patent, Patent No. [9,492,240, 9492240]

[8] Augmented reality image guidance for minimally invasive coronary artery bypass [J].

Figl, Michael ;

Rueckert, Daniel ;

Hawkes, David ;

Casula, Roberto ;

Hu, Mingxing ;

Pedro, Ose ;

Zhang, Dong Ping ;

Penney, Graeme ;

Bello, Fernando ;

Edwards, Philip .

MEDICAL IMAGING 2008: VISUALIZATION, IMAGE-GUIDED PROCEDURES, AND MODELING, PTS 1 AND 2, 2008, 6918

[9]

Forte M-P., 2018, THESIS POLITECNICO M

[10]

Geoghegan R, 2019, IEEE ENG MED BIO, P5851, DOI [10.1109/embc.2019.8856971, 10.1109/EMBC.2019.8856971]

← 1 2 3 4 →