Selective image similarity measure for bronchoscope tracking based on image registration

被引:68
作者
Deguchi, Daisuke [1 ]
Mori, Kensaku [1 ]
Feuerstein, Marco [1 ]
Kitasaka, Takayuki [2 ]
Maurer, Calvin R., Jr. [3 ]
Suenaga, Yasuhito [1 ]
Takabatake, Hirotsugu [4 ]
Mori, Masaki [5 ]
Natori, Hiroshi [6 ]
机构
[1] Nagoya Univ, Grad Sch Informat Sci, Chikusa Ku, Nagoya, Aichi 4648603, Japan
[2] Aichi Inst Technol, Fac Informat Sci, Toyota, Aichi 4700392, Japan
[3] Stanford Univ, Dept Neurosurg, Stanford, CA 94305 USA
[4] Minami Sanjo Hosp, Chuou Ku, Sapporo, Hokkaido 0600061, Japan
[5] Sapporo Kosei Gen Hosp, Chuou Ku, Sapporo, Hokkaido 0600061, Japan
[6] Sapporo Med Univ, Sch Med, Chuou Ku, Sapporo, Hokkaido 0608556, Japan
关键词
Bronchoscopy; Virtual bronchoscopy; Image registration; Image similarity; Motion recovery; Video image analysis; Tracking; Camera tracking; CT; SYSTEM; CALIBRATION; GUIDANCE; REAL;
D O I
10.1016/j.media.2009.06.001
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose a selective method of measurement for computing image similarities based on characteristic structure extraction and demonstrate its application to flexible endoscope navigation, in particular to a bronchoscope navigation system. Camera motion tracking is a fundamental function required for image-guided treatment or therapy systems. In recent years, an ultra-tiny electromagnetic sensor commercially became available, and many image-guided treatment or therapy systems use this sensor for tracking the camera position and orientation. However, due to space limitations, it is difficult to equip the tip of a bronchoscope with such a position sensor, especially in the case of ultra-thin bronchoscopes. Therefore, continuous image registration between real and virtual bronchoscopic images becomes an efficient tool for tracking the bronchoscope. Usually, image registration is done by calculating the image similarity between real and virtual bronchoscopic images. Since global schemes to measure image similarity, such as mutual information, squared gray-level difference, or cross correlation, average differences in intensity values over an entire region, they fail at tracking of scenes where less characteristic structures can be observed. The proposed method divides an entire image into a set of small subblocks and only selects those in which characteristic shapes are observed. Then image similarity is calculated within the selected subblocks. Selection is done by calculating feature values within each subblock. We applied our proposed method to eight pairs of chest X-ray CT images and bronchoscopic video images. The experimental results revealed that bronchoscope tracking using the proposed method could track up to 1600 consecutive bronchoscopic images (about 50 s) without external position sensors. Tracking performance was greatly improved in comparison with a standard method utilizing squared gray-level differences of the entire images. (C) 2009 Elsevier B.V. All rights reserved.
引用
收藏
页码:621 / 633
页数:13
相关论文
共 36 条
[1]  
Acton FormanS., 1990, Numerical methods that usually work, chapter Minimum Methods, P464
[2]  
[Anonymous], 2008, Image-Guided Interventions: Technology and Applications. First
[3]   Registration of real and CT-derived virtual bronchoscopic images to assist transbronchial biopsy [J].
Bricault, I ;
Ferretti, G ;
Cinquin, P .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1998, 17 (05) :703-714
[4]   Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery [J].
Burschka, D ;
Li, M ;
Ishii, M ;
Taylor, RH ;
Hager, GD .
MEDICAL IMAGE ANALYSIS, 2005, 9 (05) :413-426
[5]  
CARAMELLA D, 2002, 3D IMAGE PROCESSING
[6]   Semiautomatic 3-D image registration as applied to interventional MRI liver cancer treatment [J].
Carrillo, A ;
Duerk, JL ;
Lewin, JS ;
Wilson, DL .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2000, 19 (03) :175-185
[7]   Patient-specific bronchoscopy visualization through BRDF estimation and disocclusion correction [J].
Chung, AJ ;
Deligianni, F ;
Shah, P ;
Wells, A ;
Yang, GZ .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2006, 25 (04) :503-513
[8]   Nonrigid 2-D/3-D registration for patient specific bronchoscopy simulation with statistical shape modeling: Phantom validation [J].
Deligianni, Fani ;
Chung, Adrian J. ;
Yang, Guang-Zhong .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2006, 25 (11) :1462-1471
[9]   Design and evaluation of a system for microscope-assisted guided interventions (MAGI) [J].
Edwards, PJ ;
King, AP ;
Maurer, CR ;
de Cunha, DA ;
Hawkes, DJ ;
Hill, DLG ;
Gaston, RP ;
Fenlon, MR ;
Jusczyzck, A ;
Strong, AJ ;
Chandler, CL ;
Gleeson, MJ .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2000, 19 (11) :1082-1093
[10]  
Forsyth DA, 2002, COMPUTER VISION MODE