Quicksilver: Fast predictive image registration - A deep learning approach

被引:453
作者
Yang, Xiao [1 ]
Kwitt, Roland [4 ]
Styner, Martin [1 ,3 ]
Niethammer, Marc [1 ,2 ]
机构
[1] Univ North Carolina Chapel Hill, Chapel Hill, NC 27599 USA
[2] BRIC, Chapel Hill, NC USA
[3] UNC, Dept Psychiat, Chapel Hill, NC USA
[4] Univ Salzburg, Dept Comp Sci, Salzburg, Austria
基金
美国国家科学基金会;
关键词
Image registration; Deep learning; Brain imaging; DIFFEOMORPHISMS; SEGMENTATION; ALGORITHMS; FLOWS;
D O I
10.1016/j.neuroimage.2017.07.008
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
This paper introduces Quicksilver, a fast deformable image registration method. Quicksilver registration for image-pairs works by patch-wise prediction of a deformation model based directly on image appearance. A deep encoder-decoder network is used as the prediction model. While the prediction strategy is general, we focus on predictions for the Large Deformation Diffeomorphic Metric Mapping (LDDMM) model. Specifically, we predict the momentum-parameterization of LDDMM, which facilitates a patch-wise prediction strategy while maintaining the theoretical properties of LDDMM, such as guaranteed diffeomorphic mappings for sufficiently strong regularization. We also provide a probabilistic version of our prediction network which can be sampled during the testing time to calculate uncertainties in the predicted deformations. Finally, we introduce a new correction network which greatly increases the prediction accuracy of an already existing prediction network. We show experimental results for uni-modal atlas-to-image as well as uni-/multi-modal image-to-image registrations. These experiments demonstrate that our method accurately predicts registrations obtained by numerical optimization, is very fast, achieves state-of-the-art registration results on four standard validation datasets, and can jointly learn an image similarity measure. Quicksilver is freely available as an open-source software.
引用
收藏
页码:378 / 396
页数:19
相关论文
共 70 条
[1]  
[Anonymous], 2015, ABS150201852 CORR
[2]   Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans [J].
Ardekani, BA ;
Guckemus, S ;
Bachman, A ;
Hoptman, MJ ;
Wojtaszek, M ;
Nierenberg, J .
JOURNAL OF NEUROSCIENCE METHODS, 2005, 142 (01) :67-76
[3]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[4]   Diffeomorphic registration using geodesic shooting and Gauss-Newton optimisation [J].
Ashburner, John ;
Friston, Karl J. .
NEUROIMAGE, 2011, 55 (03) :954-967
[5]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[6]   Computing large deformation metric mappings via geodesic flows of diffeomorphisms [J].
Beg, MF ;
Miller, MI ;
Trouvé, A ;
Younes, L .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 61 (02) :139-157
[7]   Optimal control formulation for determining optical flow [J].
Borzì, A ;
Ito, K ;
Kunisch, K .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2002, 24 (03) :818-847
[8]   MIXTURE OF KERNELS AND ITERATED SEMIDIRECT PRODUCT OF DIFFEOMORPHISMS GROUPS [J].
Bruveris, Martins ;
Risser, Laurent ;
Vialard, Francois-Xavier .
MULTISCALE MODELING & SIMULATION, 2012, 10 (04) :1344-1368
[9]  
Cao T, 2015, I S BIOMED IMAGING, P691, DOI 10.1109/ISBI.2015.7163967
[10]   Multi-modal registration for correlative microscopy using image analogies [J].
Cao, Tian ;
Zach, Christopher ;
Modla, Shannon ;
Powell, Debbie ;
Czymmek, Kirk ;
Niethammer, Marc .
MEDICAL IMAGE ANALYSIS, 2014, 18 (06) :914-926