Feature-based multi-resolution registration of immunostained serial sections

被引:25
作者
Lobachev, Oleg [1 ]
Ulrich, Christine [2 ]
Steiniger, Birte S. [3 ]
Wilhelmi, Verena [3 ]
Stachniss, Vitus [4 ]
Guthe, Michael [1 ]
机构
[1] Univ Bayreuth, Visual Comp, D-95440 Bayreuth, Germany
[2] Philipps Univ Marburg, Psychol, D-35037 Marburg, Germany
[3] Philipps Univ Marburg, Inst Anat & Cell Biol, D-35037 Marburg, Germany
[4] Philipps Univ Marburg, Restorat Dent & Endodont, D-35037 Marburg, Germany
关键词
Registration; Multi-resolution; Feature detection; Splines; Histology; MEDICAL IMAGE REGISTRATION; RED PULP CAPILLARY; NONRIGID REGISTRATION; VOLUME RECONSTRUCTION; ELASTIC REGISTRATION; MOUSE-BRAIN; WHITE PULP; ROBUST; MICROVASCULATURE; NORMALIZATION;
D O I
10.1016/j.media.2016.07.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The form and exact function of the blood vessel network in some human organs, like spleen and bone marrow, are still open research questions in medicine. In this paper, we propose a method to register the immunohistological stainings of serial sections of spleen and bone marrow specimens to enable the visualization and visual inspection of blood vessels. As these vary much in caliber, from mesoscopic (millimeter-range) to microscopic (few micrometers, comparable to a single erythrocyte), we need to utilize a multi-resolution approach. Our method is fully automatic; it is based on feature detection and sparse matching. We utilize a rigid alignment and then a non-rigid deformation, iteratively dealing with increasingly smaller features. Our tool pipeline can already deal with series of complete scans at extremely high resolution, up to 620 megapixels. The improvement presented increases the range of represented details up to smallest capillaries. This paper provides details on the multi-resolution non-rigid registration approach we use. Our application is novel in the way the alignment and subsequent deformations are computed (using features, i.e. "sparse"). The deformations are based on all images in the stack ("global"). We also present volume renderings and a 3D reconstruction of the vascular network in human spleen and bone marrow on a level not possible before. Our registration makes easy tracking of even smallest blood vessels possible, thus granting experts a better comprehension. A quantitative evaluation of our method and related state of the art approaches with seven different quality measures shows the efficiency of our method. We also provide z-profiles and enlarged volume renderings from three different registrations for visual inspection. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:288 / 302
页数:15
相关论文
共 66 条
[1]  
Alahi A, 2012, PROC CVPR IEEE, P510, DOI 10.1109/CVPR.2012.6247715
[2]   KAZE Features [J].
Alcantarilla, Pablo Fernandez ;
Bartoli, Adrien ;
Davison, Andrew J. .
COMPUTER VISION - ECCV 2012, PT VI, 2012, 7577 :214-227
[3]   Registration of standardized histological images in feature space [J].
Bagci, Ulas ;
Bai, Li .
MEDICAL IMAGING 2008: IMAGE PROCESSING, PTS 1-3, 2008, 6914
[4]   Hierarchical Scale-Based Multiobject Recognition of 3-D Anatomical Structures [J].
Bagci, Ulas ;
Chen, Xinjian ;
Udupa, Jayaram K. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2012, 31 (03) :777-789
[5]   Automatic Best Reference Slice Selection for Smooth Volume Reconstruction of a Mouse Brain From Histological Images [J].
Bagci, Ulas ;
Bai, Li .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (09) :1688-1696
[6]   Speeded-Up Robust Features (SURF) [J].
Bay, Herbert ;
Ess, Andreas ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2008, 110 (03) :346-359
[7]   A METHOD FOR REGISTRATION OF 3-D SHAPES [J].
BESL, PJ ;
MCKAY, ND .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) :239-256
[8]   A SURVEY OF IMAGE REGISTRATION TECHNIQUES [J].
BROWN, LG .
COMPUTING SURVEYS, 1992, 24 (04) :325-376
[9]   A feature-based, robust, hierarchical algorithm for registering pairs of images of the curved human retina [J].
Can, A ;
Stewart, CV ;
Roysam, B ;
Tanenbaum, HL .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (03) :347-364
[10]   Elastic registration of multimodal prostate MRI and histology via multiattribute combined mutual information [J].
Chappelow, Jonathan ;
Bloch, B. Nicolas ;
Rofsky, Neil ;
Genega, Elizabeth ;
Lenkinski, Robert ;
DeWolf, William ;
Madabhushi, Anant .
MEDICAL PHYSICS, 2011, 38 (04) :2005-2018