The Edge-Driven Dual-Bootstrap Iterative Closest Point Algorithm for Registration of Multimodal Fluorescein Angiogram Sequence

被引:88
作者
Tsai, Chia-Ling [1 ]
Li, Chun-Yi [2 ]
Yang, Gehua [3 ]
Lin, Kai-Shung [2 ]
机构
[1] Iona Coll, Dept Comp Sci, New Rochelle, NY 10801 USA
[2] Natl Chung Cheng Univ, Dept Comp Sci & Informat Engn, Chiayi, Taiwan
[3] DualAlign LLC, Clifton Pk, NY 12065 USA
关键词
Fluorescein angiogram; iterative closest point; keypoint matching; registration; retinal imaging; RETINAL IMAGES; FUNDUS IMAGES; ROBUST;
D O I
10.1109/TMI.2009.2030324
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Motivated by the need for multimodal image registration in ophthalmology, this paper introduces an algorithm which is tailored to jointly align in a common reference space all the images in a complete fluorescein angiogram (FA) sequence, which contains both red-free (RF) and FA images. Our work is inspired by Generalized Dual-Bootstrap Iterative Closest Point (GDB-ICP), which rank-orders Lowe keypoint matches and refines the transformation, going from local and low-order to global and higher-order model, computed from each keypoint match in succession. Albeit GDB-ICP has been shown to be robust in registering images taken under different lighting conditions, the performance is not satisfactory for image pairs with substantial, nonlinear intensity differences. Our algorithm, named Edge-Driven DB-ICP, targeting the least reliable component of GDB-ICP, modifies generation of keypoint matches for initialization by extracting the Lowe keypoints from the gradient magnitude image and enriching the keypoint descriptor with global-shape context using the edge points. Our dataset consists of 60 randomly-selected pathological sequences, each on average having up to two RF and 13 FA images. Edge-Driven DB-ICP successfully registered 92.4% of all pairs, and 81.1% multimodal pairs, whereas GDB-ICP registered 80.1% and 40.1%, respectively. For the joint registration of all images in a sequence, Edge-Driven DB-ICP succeeded in 59 sequences, which is a 23% improvement over GDB-ICP.
引用
收藏
页码:636 / 649
页数:14
相关论文
共 54 条
[1]  
[Anonymous], PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2005.45
[2]  
[Anonymous], 2000, Multiple View Geometry in Computer Vision
[3]  
[Anonymous], P ECCV
[4]  
BECKER KH, 1998, PHYS CHEM, V45, P1
[5]   Shape matching and object recognition using shape contexts [J].
Belongie, S ;
Malik, J ;
Puzicha, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (04) :509-522
[6]  
BERKOW J.W., 1997, Fluorescein and Indocyanine Green Angiography - Technique and Interpretation, Ed
[7]   A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retina [J].
Can, A ;
Stewart, CV ;
Roysam, B ;
Tanenbaum, HL .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :347-364
[8]   A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: Mosaicing the curved human retina [J].
Can, A ;
Stewart, CV ;
Roysam, B ;
Tanenbaum, HL .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :412-419
[9]  
Can Nguyen Duy, 1999, Plant Production Science, V2, P125
[10]  
Carneiro G, 2003, PROC CVPR IEEE, P736