A deep learning framework for unsupervised affine and deformable image registration

被引:578
作者
de Vos, Bob D. [1 ,2 ]
Berendsen, Floris F. [3 ]
Viergever, Max A. [1 ,2 ]
Sokooti, Hessam [3 ]
Staring, Marius [3 ]
Isgum, Ivana [1 ,2 ]
机构
[1] Univ Med Ctr Utrecht, Image Sci Inst, Utrecht, Netherlands
[2] Univ Utrecht, Utrecht, Netherlands
[3] Leiden Univ, Med Ctr, Div Image Proc, Leiden, Netherlands
关键词
Deep learning; Unsupervised learning; Affine image registration; Deformable image registration; Cardiac cine MRI; Chest CT;
D O I
10.1016/j.media.2018.11.010
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image registration, the process of aligning two or more images, is the core technique of many (semi-)automatic medical image analysis tasks. Recent studies have shown that deep learning methods, notably convolutional neural networks (ConvNets), can be used for image registration. Thus far training of ConvNets for registration was supervised using predefined example registrations. However, obtaining example registrations is not trivial. To circumvent the need for predefined examples, and thereby to increase convenience of training ConvNets for image registration, we propose the Deep Learning Image Registration (DLIR) framework for unsupervised affine and deformable image registration. In the DLIR framework ConvNets are trained for image registration by exploiting image similarity analogous to conventional intensity-based image registration. After a ConvNet has been trained with the DLIR framework, it can be used to register pairs of unseen images in one shot. We propose flexible ConvNets designs for affine image registration and for deformable image registration. By stacking multiple of these ConvNets into a larger architecture, we are able to perform coarse-to-fine image registration. We show for registration of cardiac cine MRI and registration of chest CT that performance of the DLIR framework is comparable to conventional image registration while being several orders of magnitude faster. (C) 2018 Elsevier By. All rights reserved.
引用
收藏
页码:128 / 143
页数:16
相关论文
共 38 条
[1]   Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening [J].
Aberle, Denise R. ;
Adams, Amanda M. ;
Berg, Christine D. ;
Black, William C. ;
Clapp, Jonathan D. ;
Fagerstrom, Richard M. ;
Gareen, Ilana F. ;
Gatsonis, Constantine ;
Marcus, Pamela M. ;
Sicks, JoRean D. .
NEW ENGLAND JOURNAL OF MEDICINE, 2011, 365 (05) :395-409
[2]  
[Anonymous], 2009, MIDAS J
[3]  
[Anonymous], 2014, Identifying and attacking the saddle point problem in high-dimensional non-convex optimization
[4]  
[Anonymous], 2015, PROC 28 INT C NEURAL
[5]   Computing large deformation metric mappings via geodesic flows of diffeomorphisms [J].
Beg, MF ;
Miller, MI ;
Trouvé, A ;
Younes, L .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 61 (02) :139-157
[6]   Registration of organs with sliding interfaces and changing topologies [J].
Berendsen, Floris F. ;
Kotte, Alexis N. T. J. ;
Viergever, Max A. ;
Pluim, Josien P. W. .
MEDICAL IMAGING 2014: IMAGE PROCESSING, 2014, 9034
[7]  
Cao Xiaohuan, 2017, Med Image Comput Comput Assist Interv, V10433, P300, DOI 10.1007/978-3-319-66182-7_35
[8]   Four-dimensional deformable image registration using trajectory modeling [J].
Castillo, Edward ;
Castillo, Richard ;
Martinez, Josue ;
Shenoy, Maithili ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2010, 55 (01) :305-327
[9]   A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets [J].
Castillo, Richard ;
Castillo, Edward ;
Guerra, Rudy ;
Johnson, Valen E. ;
McPhail, Travis ;
Garg, Amit K. ;
Guerrero, Thomas .
PHYSICS IN MEDICINE AND BIOLOGY, 2009, 54 (07) :1849-1870
[10]   End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Staring, Marius ;
Isgum, Ivana .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :204-212