VoxelMorph: A Learning Framework for Deformable Medical Image Registration

被引:1209
作者
Balakrishnan, Guha [1 ]
Zhao, Amy [1 ]
Sabuncu, Mert R. [2 ,3 ]
Guttag, John [1 ]
Dalca, Adrian, V [1 ,4 ]
机构
[1] MIT, Comp Sci & Artificial Intelligence Lab, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] Cornell Univ, Sch Elect & Comp Engn, Ithaca, NY 14853 USA
[3] Cornell Univ, Meinig Sch Biomed Engn, Ithaca, NY 14853 USA
[4] HMS, MGH, Martinos Ctr Biomed Imaging, Boston, MA 02129 USA
关键词
Registration; machine learning; convolutional neural networks; OPTICAL-FLOW; NONRIGID REGISTRATION;
D O I
10.1109/TMI.2019.2897538
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We present VoxelMorph, a fast learning-based framework for deformable, pairwise medical image registration. Traditional registration methods optimize an objective function for each pair of images, which can be time-consuming for large datasets or rich deformation models. In contrast to this approach and building on recent learning-based methods, we formulate registration as a function that maps an input image pair to a deformation field that aligns these images. We parameterize the function via a convolutional neural network and optimize the parameters of the neural network on a set of images. Given a new pair of scans, VoxelMorph rapidly computes a deformation field by directly evaluating the function. In this paper, we explore two different training strategies. In the first (unsupervised) setting, we train the model to maximize standard image matching objective functions that are based on the image intensities. In the second setting, we leverage auxiliary segmentations available in the training data. We demonstrate that the unsupervised model's accuracy is comparable to the state-of-the-art methods while operating orders of magnitude faster. We also show that VoxelMorph trained with auxiliary data improves registration accuracy at test time and evaluate the effect of training set size on registration. Our method promises to speed up medical image analysis and processing pipelines while facilitating novel directions in learning-based registration and its applications. Our code is freely available at https://github.com/voxelmorph/voxelmorph.
引用
收藏
页码:1788 / 1800
页数:13
相关论文
共 77 条
  • [1] Abadi M., 2015, TensorFlow: Large-scale machine learning on heterogeneous systems
  • [2] The ADHD-200 Consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience
    Acuna, Carlos
    [J]. FRONTIERS IN SYSTEMS NEUROSCIENCE, 2012, 6
  • [3] Ahmadi A, 2016, IEEE IMAGE PROC, P1629, DOI 10.1109/ICIP.2016.7532634
  • [4] [Anonymous], P IEEE C COMP VIS PA
  • [5] [Anonymous], 2018, Semi-amortized variational autoencoders
  • [6] [Anonymous], IEEE T PATTERN ANAL
  • [7] [Anonymous], 2018, Inference suboptimality in variational autoencoders
  • [8] [Anonymous], 2017, NONRIGID IMAGE REGIS
  • [9] [Anonymous], UNSUPERVISED LEARNIN
  • [10] [Anonymous], FULLY TRAINABLE DEEP