Dual-camera laparoscopic imaging with super-resolution reconstruction for intraoperative hyperspectral image guidance

被引:0
作者
Ma, Ling [1 ,2 ]
Pruitt, Kelden [1 ,2 ]
Fei, Baowei [1 ,2 ,3 ]
机构
[1] Univ Texas Dallas, Ctr Imaging & Surg Innovat, Richardson, TX 75083 USA
[2] Univ Texas Dallas, Dept Bioengn, Richardson, TX 75083 USA
[3] Univ Texas Southwestern Med Ctr, Dept Radiol, Dallas, TX 75390 USA
来源
IMAGE-GUIDED PROCEDURES, ROBOTIC INTERVENTIONS, AND MODELING, MEDICAL IMAGING 2024 | 2024年 / 12928卷
基金
美国国家卫生研究院;
关键词
Hyperspectral imaging; super resolution reconstruction; laparoscopic surgery; image guidance; intraoperative;
D O I
10.1117/12.3006573
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Laparoscopic and robotic surgery, as one type of minimally invasive surgery (MIS), has gained popularity due to the improved surgeon ergonomics, instrument precision, operative time, and postoperative recovery. Hyperspectral imaging (HSI) is an emerging medical imaging modality, which has proved useful for intraoperative image guidance. Snapshot hyperspectral cameras are ideal for intraoperative laparoscopic imaging because of their compact size and light weight, but low spatial resolution can be a limitation. In this work, we developed a dual-camera laparoscopic imaging system that consists of a high-resolution color camera and a snapshot hyperspectral camera, and we employed super-resolution reconstruction to fuse the images from both cameras to generate high-resolution hyperspectral images. The experimental results show that our method can significantly improve the resolution of hyperspectral images without compromising the image quality or spectral signatures. The proposed super-resolution reconstruction method is promising to promote the employment of high-speed hyperspectral imaging in laparoscopic surgery.
引用
收藏
页数:8
相关论文
共 18 条
[1]   Indocyanine Green-Enhanced Colorectal Surgery-between Being Superfluous and Being a Game-Changer [J].
Alius, Catalin ;
Tudor, Corneliu ;
Badiu, Cristinel Dumitru ;
Dascalu, Ana Maria ;
Smarandache, Catalin Gabriel ;
Sabau, Alexandru Dan ;
Tanasescu, Ciprian ;
Balasescu, Simona Andreea ;
Serban, Dragos .
DIAGNOSTICS, 2020, 10 (10)
[2]   Systematic review of augmented reality in urological interventions: the evidences of an impact on surgical outcomes are yet to come [J].
Bertolo, Riccardo ;
Hung, Andrew ;
Porpiglia, Francesco ;
Bove, Pierluigi ;
Schleicher, Mary ;
Dasgupta, Prokar .
WORLD JOURNAL OF UROLOGY, 2020, 38 (09) :2167-2176
[3]   Intraoperative colon perfusion assessment using multispectral imaging [J].
Clancy, Neil T. ;
Soares, Antonio S. ;
Bano, Sophia ;
Lovat, Laurence B. ;
Chand, Manish ;
Stoyanov, Danail .
BIOMEDICAL OPTICS EXPRESS, 2021, 12 (12) :7556-7567
[4]   Rapid, label-free detection of cerebral ischemia in rats using hyperspectral imaging [J].
Fu, Chuhua ;
Ma, Kang ;
Li, Zhao ;
Wang, Haifeng ;
Chen, Tunan ;
Zhang, Dayong ;
Wang, Shi ;
Mu, Ning ;
Yang, Chuanyan ;
Zhao, Lu ;
Gong, Sheng ;
Feng, Hua ;
Li, Fei .
JOURNAL OF NEUROSCIENCE METHODS, 2020, 329
[5]   Hyperspectral imaging in perfusion and wound diagnostics - methods and algorithms for the determination of tissue parameters [J].
Holmer, Amadeus ;
Marotz, Joerg ;
Wahl, Philip ;
Dau, Michael ;
Kaemmerer, Peer W. .
BIOMEDICAL ENGINEERING-BIOMEDIZINISCHE TECHNIK, 2018, 63 (05) :547-556
[6]   Oxygenation and perfusion monitoring with a hyperspectral camera system for chemical based tissue analysis of skin and organs [J].
Holmer, Amadeus ;
Tetschke, Florian ;
Marotz, Joerg ;
Malberg, Hagen ;
Markgraf, Wenke ;
Thiele, Christine ;
Kulcke, Axel .
PHYSIOLOGICAL MEASUREMENT, 2016, 37 (11) :2064-2078
[7]  
Ketkar N., 2017, Deep Learning with Python: A Hands-on Introduction
[8]  
Kingma D.P., 2014, arXiv, DOI [DOI 10.48550/ARXIV.1412.6980, 10.48550/arXiv.1412.6980]
[9]   New method for detection of gastric cancer by hyperspectral imaging: a pilot study [J].
Kiyotoki, Shu ;
Nishikawa, Jun ;
Okamoto, Takeshi ;
Hamabe, Kouichi ;
Saito, Mari ;
Goto, Atsushi ;
Fujita, Yusuke ;
Hamamoto, Yoshihiko ;
Takeuchi, Yusuke ;
Satori, Shin ;
Sakaida, Isao .
JOURNAL OF BIOMEDICAL OPTICS, 2013, 18 (02)
[10]   New Intraoperative Imaging Tools and Image-Guided Surgery in Gastric Cancer Surgery [J].
Knospe, Luise ;
Gockel, Ines ;
Jansen-Winkeln, Boris ;
Thieme, Rene ;
Niebisch, Stefan ;
Moulla, Yusef ;
Stelzner, Sigmar ;
Lyros, Orestis ;
Diana, Michele ;
Marescaux, Jacques ;
Chalopin, Claire ;
Koehler, Hannes ;
Pfahl, Annekatrin ;
Maktabi, Marianne ;
Park, Ji-Hyeon ;
Yang, Han-Kwang .
DIAGNOSTICS, 2022, 12 (02)