Light source calibration for multispectral imaging in surgery

被引:5
作者
Ayala, Leonardo [1 ]
Seidlitz, Silvia [1 ,2 ]
Vemuri, Anant [1 ]
Wirkert, Sebastian J. [1 ]
Kirchner, Thomas [1 ]
Adler, Tim J. [1 ,3 ]
Engels, Christina [5 ]
Teber, Dogu [5 ]
Maier-Hein, Lena [1 ,4 ]
机构
[1] German Canc Res Ctr, Div Comp Assisted Med Intervent, Heidelberg, Germany
[2] HIDSS4Hlth Helmholtz Informat & Data Sci Sch Hlth, Heidelberg, Germany
[3] Heidelberg Univ, Fac Math & Comp Sci, Heidelberg, Germany
[4] Heidelberg Univ, Med Fac, Heidelberg, Germany
[5] Stadt Klinikum Karlsruhe, Urol Klin, Karlsruhe, Germany
基金
欧洲研究理事会;
关键词
Specular highlights; Dichromatic reflection model; Illuminant spectral estimation; Multispectral imaging; Perfusion imaging; Surgical data science; ILLUMINANT ESTIMATION;
D O I
10.1007/s11548-020-02195-y
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Purpose Live intra-operative functional imaging has multiple potential clinical applications, such as localization of ischemia, assessment of organ transplantation success and perfusion monitoring. Recent research has shown that live monitoring of functional tissue properties, such as tissue oxygenation and blood volume fraction, is possible using multispectral imaging in laparoscopic surgery. While the illuminant spectrum is typically kept constant in laparoscopic surgery and can thus be estimated from preoperative calibration images, a key challenge in open surgery originates from the dynamic changes of lighting conditions. Methods The present paper addresses this challenge with a novel approach to light source calibration based on specular highlight analysis. It involves the acquisition of low-exposure time images serving as a basis for recovering the illuminant spectrum from pixels that contain a dominant specular reflectance component. Results Comprehensive in silico and in vivo experiments with a range of different light sources demonstrate that our approach enables an accurate and robust recovery of the illuminant spectrum in the field of view of the camera, which results in reduced errors with respect to the estimation of functional tissue properties. Our approach further outperforms state-of-the-art methods proposed in the field of computer vision. Conclusion Our results suggest that low-exposure multispectral images are well suited for light source calibration via specular highlight analysis. This work thus provides an important first step toward live functional imaging in open surgery.
引用
收藏
页码:1117 / 1125
页数:9
相关论文
共 19 条
[1]   An Overview of Color Constancy Algorithms [J].
Agarwal, Vivek ;
Abidi, Besma R. ;
Koschan, Andreas ;
Abidi, Mongi A. .
JOURNAL OF PATTERN RECOGNITION RESEARCH, 2006, 1 (01) :42-54
[2]  
ANTONIO RK, 2013, IMAGING SPECTROSCOPY, P24
[3]  
Bianco S, 2015, IEEE COMPUT SOC CONF
[4]   Single and Multiple Illuminant Estimation Using Convolutional Neural Networks [J].
Bianco, Simone ;
Cusano, Claudio ;
Schettini, Raimondo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (09) :4347-4362
[5]  
Finlayson GD, 2004, 12TH COLOR IMAGING CONFERENCE: COLOR SCIENCE AND ENGINEERING SYSTEMS, TECHNOLOGIES, APPLICATIONS, P37
[6]   Solving for colour constancy using a constrained dichromatic reflection model [J].
Finlayson, GD ;
Schaefer, G .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2001, 42 (03) :127-144
[7]   RADIOMETRIC CCD CAMERA CALIBRATION AND NOISE ESTIMATION [J].
HEALEY, GE ;
KONDEPUDY, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (03) :267-276
[8]   Hyperspectral imaging in perfusion and wound diagnostics - methods and algorithms for the determination of tissue parameters [J].
Holmer, Amadeus ;
Marotz, Joerg ;
Wahl, Philip ;
Dau, Michael ;
Kaemmerer, Peer W. .
BIOMEDICAL ENGINEERING-BIOMEDIZINISCHE TECHNIK, 2018, 63 (05) :547-556
[9]   FC4: Fully Convolutional Color Constancy with Confidence-weighted Pooling [J].
Hu, Yuanming ;
Wang, Baoyuan ;
Lin, Stephen .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :330-339
[10]  
Imai Y, 2011, LECT NOTES COMPUT SC, V6626, P85, DOI 10.1007/978-3-642-20404-3_7