The Future of Endoscopic Navigation: A Review of Advanced Endoscopic Vision Technology

被引：41

作者：

Fu, Zuoming ^{[1
]}

Jin, Ziyi ^{[1
]}

Zhang, Chongan ^{[1
]}

He, Zhongyu ^{[1
]}

Zha, Zhenzhou ^{[1
]}

Hu, Chunyong ^{[1
]}

Gan, Tianyuan ^{[1
]}

Yan, Qinglai ^{[2
]}

Wang, Peng ^{[1
]}

Ye, Xuesong ^{[1
]}

机构：

[1] Zhejiang Univ, Coll Biomed Engn & Instrument Sci, Minist Educ, Biosensor Natl Special Lab,Key Lab Biomed Engn, Hangzhou 310027, Peoples R China

[2] CFDA, Hangzhou Ctr Med Device Qual Supervis & Testing, Hangzhou 310000, Peoples R China

来源：

IEEE ACCESS | 2021年 / 9卷

关键词：

Endoscopes; Navigation; Surgery; Instruments; Imaging; Minimally invasive surgery; Lesions; Endoscopic navigation; endoscopic vision; endoscopic view expansion; instrument tracking; suspicious lesion tracking; HELICOBACTER-PYLORI INFECTION; ARTIFICIAL-INTELLIGENCE; CAMERA CALIBRATION; 3D RECONSTRUCTION; TOOL DETECTION; SURGICAL-INSTRUMENTS; DEPTH ESTIMATION; GASTRIC-CANCER; NEURAL-NETWORK; TRACKING;

D O I：

10.1109/ACCESS.2021.3065104

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

Minimally invasive medicine has become mainstream because of its crucial clinical significance in providing a low risk of postoperative complications, limited blood loss, short postoperative recovery time, and small sizes of associated physiological tissue wounds. Endoscopic navigation systems comprise a research hot spot in medical science and technology and are an essential means to achieve precision medicine and improve surgical operation safety. As a core component in endoscopic navigation during minimally invasive surgery, endoscopes play a critical role in disease diagnosis and treatment. The development of endoscopic vision technologies has resulted in a renewed drive to further develop endoscopic navigation systems. Multiple endoscopic optical imaging modalities provide data sources for endoscopic vision technology, including white-light endoscopy, contrast-enhanced imaging and technologies involving magnified observation. Endoscopic vision is a specific application of computer vision involving the use of endoscopes that include instrument tracking, endoscopic view expansion, and suspicious lesion tracking in the application of endoscopic navigation. These techniques help surgeons or surgical robots locate instruments and lesions and expand the field of view of the endoscope. Although these technologies have been applied to various clinical and pre-clinical diagnoses and treatments, the use and combination of these advanced technologies in endoscopic navigation system for specific clinical requirements remains challenging. This review performs a broad survey of advanced endoscopic vision technologies and their application in endoscopic navigation systems. Finally, we discuss the challenges and future directions in implementing and developing endoscopic navigation systems.

引用

页码：41144 / 41167

页数：24

共 213 条

[1]

Abdel-Hakim A.E., 2006, CVPR, V2, P1978, DOI 10.1109/CVPR.2006.95

[2]

Abdelalim A. J. T. L., The Lancet, V392

[3] A Fluorescence-Based Wireless Capsule Endoscopy System for Detecting Colorectal Cancer [J].

Alam, Mohammad Wajih ;

Vedaei, Seyed Shahim ;

Wahid, Khan A. .

CANCERS, 2020, 12 (04)

[4] Toward Detection and Localization of Instruments in Minimally Invasive Surgery [J].

Allan, Max ;

Ourselin, Sebastien ;

Thompson, Steve ;

Hawkes, David J. ;

Kelly, John ;

Stoyanov, Danail .

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2013, 60 (04) :1050-1058

[5] Localization of Pulmonary Nodules Using Navigation Bronchoscope and a Near-Infrared Fluorescence Thoracoscope [J].

Anayama, Takashi ;

Qiu, Jimmy ;

Chan, Harley ;

Nakajima, Takahiro ;

Weersink, Robert ;

Daly, Michael ;

McConnell, Judy ;

Waddell, Thomas ;

Keshavjee, Shaf ;

Jaffray, David ;

Irish, Jonathan C. ;

Hirohashi, Kentaro ;

Wada, Hironobu ;

Orihashi, Kazumasa ;

Yasufuku, Kazuhiro .

ANNALS OF THORACIC SURGERY, 2015, 99 (01) :224-230

[6] Laparoscopic Liver Surgery Guided by Virtual Real-time CT-Guided Volume Navigation [J].

Aoki, Takeshi ;

Mansour, Doaa A. ;

Koizumi, Tomotake ;

Wada, Yusuke ;

Enami, Yuta ;

Fujimori, Akira ;

Kusano, Tomokazu ;

Matsuda, Kazuhiro ;

Nogaki, Koji ;

Tashiro, Yoshihiko ;

Hakozaki, Tomoki ;

Shibata, Hideki ;

Tomioka, Kodai ;

Hirai, Takahito ;

Yamazaki, Tatsuya ;

Saito, Kazuhiko ;

Goto, Satoru ;

Watanabe, Makoto ;

Otsuka, Koji ;

Murakami, Masahiko .

JOURNAL OF GASTROINTESTINAL SURGERY, 2021, 25 (07) :1779-1786

[7] Unsupervised Learning of Endoscopy Video Frames' Correspondences from Global and Local Transformation [J].

Armin, Mohammad Ali ;

Barnes, Nick ;

Khan, Salman ;

Liu, Miaomiao ;

Grimpen, Florian ;

Salvado, Olivier .

OR 2.0 CONTEXT-AWARE OPERATING THEATERS, COMPUTER ASSISTED ROBOTIC ENDOSCOPY, CLINICAL IMAGE-BASED PROCEDURES, AND SKIN IMAGE ANALYSIS, OR 2.0 2018, 2018, 11041 :108-117

[8] Peripheral Lung Nodule Diagnosis and Fiducial Marker Placement Using a Novel Tip-Tracked Electromagnetic Navigation Bronchoscopy System [J].

Belanger, Adam R. ;

Burks, Allen C. ;

Chambers, David M. ;

Ghosh, Sohini ;

MacRosty, Christina R. ;

Conterato, Anna J. ;

Rivera, M. Patricia ;

Akulian, Jason A. .

JOURNAL OF BRONCHOLOGY & INTERVENTIONAL PULMONOLOGY, 2019, 26 (01) :41-48

[9]

Bernhardt Sylvain, 2013, Medical Computer Vision. Recognition Techniques and Applications in Medical Imaging. Second International MICCAI Workshop, MCV 2012. Revised Selected Papers, P254, DOI 10.1007/978-3-642-36620-8_25

[10] High-definition and high-magnification endoscopes [J].

Bhat, Yasser M. ;

Abu Dayyeh, Barham K. ;

Chauhan, Shailendra S. ;

Gottlieb, Klaus T. ;

Hwang, Joo Ha ;

Komanduri, Sri ;

Konda, Vani ;

Lo, Simon K. ;

Manfredi, Michael A. ;

Maple, John T. ;

Murad, Faris M. ;

Siddiqui, Uzma D. ;

Banerjee, Subhas ;

Wallace, Michael B. .

GASTROINTESTINAL ENDOSCOPY, 2014, 80 (06) :919-927

← 1 2 3 4 5 6 7 8 9 10 →