BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:206
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 65 条
[31]   Fast deformable registration on the GPU:: A CUDA implementation of demons [J].
Muyan-Ozcelik, Pinar ;
Owens, John D. ;
Xia, Junyi ;
Samant, Sanjiv S. .
INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCES AND ITS APPLICATIONS, PROCEEDINGS, 2008, :223-+
[32]   Intensity-Based Image Registration by Minimizing Residual Complexity [J].
Myronenko, Andriy ;
Song, Xubo .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (11) :1882-1891
[33]   Medical image registration: a review [J].
Oliveira, Francisco P. M. ;
Tavares, Joao Manuel R. S. .
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2014, 17 (02) :73-93
[34]   DRAMMS: Deformable registration via attribute matching and mutual-saliency weighting [J].
Ou, Yangming ;
Sotiras, Aristeidis ;
Paragios, Nikos ;
Davatzikos, Christos .
MEDICAL IMAGE ANALYSIS, 2011, 15 (04) :622-639
[35]  
Parajuli Nripesh, 2017, Medical Image Computing and Computer-Assisted Intervention, MICCAI 2017. 20th International Conference. Proceedings: LNCS 10434, P279, DOI 10.1007/978-3-319-66185-8_32
[36]  
Rohe Marc-Michel, 2017, Medical Image Computing and Computer Assisted Intervention MICCAI 2017. 20th International Conference. Proceedings: LNCS 10433, P266, DOI 10.1007/978-3-319-66182-7_31
[37]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[38]   Automatic construction of 3-D statistical deformation models of the brain using nonrigid registration [J].
Rueckert, D ;
Frangi, AF ;
Schnabel, JA .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2003, 22 (08) :1014-1025
[39]  
Rueckert D., 2001, Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention, P77
[40]  
Samant S, 2015, SERIES MED PHYS BIOM, P129