BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [1] NON-RIGID IMAGE REGISTRATION USING SELF-SUPERVISED FULLY CONVOLUTIONAL NETWORKS WITHOUT TRAINING DATA
    Li, Hongming
    Fan, Yong
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1075 - 1078
  • [2] Generating anthropomorphic phantoms using fully unsupervised deformable image registration with convolutional neural networks
    Chen, Junyu
    Li, Ye
    Du, Yong
    Frey, Eric C.
    MEDICAL PHYSICS, 2020, 47 (12) : 6366 - 6380
  • [3] DeepMapi: a Fully Automatic Registration Method for Mesoscopic Optical Brain Images Using Convolutional Neural Networks
    Ni, Hong
    Feng, Zhao
    Guan, Yue
    Jia, Xueyan
    Chen, Wu
    Jiang, Tao
    Zhong, Qiuyuan
    Yuan, Jing
    Ren, Miao
    Li, Xiangning
    Gong, Hui
    Luo, Qingming
    Li, Anan
    NEUROINFORMATICS, 2021, 19 (02) : 267 - 284
  • [4] Brain CT registration using hybrid supervised convolutional neural network
    Hongmei Yuan
    Minglei Yang
    Shan Qian
    Wenxin Wang
    Xiaotian Jia
    Feng Huang
    BioMedical Engineering OnLine, 20
  • [5] Image synthesis-based multi-modal image registration framework by using deep fully convolutional networks
    Liu, Xueli
    Jiang, Dongsheng
    Wang, Manning
    Song, Zhijian
    MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2019, 57 (05) : 1037 - 1048
  • [6] DeepMapi: a Fully Automatic Registration Method for Mesoscopic Optical Brain Images Using Convolutional Neural Networks
    Hong Ni
    Zhao Feng
    Yue Guan
    Xueyan Jia
    Wu Chen
    Tao Jiang
    Qiuyuan Zhong
    Jing Yuan
    Miao Ren
    Xiangning Li
    Hui Gong
    Qingming Luo
    Anan Li
    Neuroinformatics, 2021, 19 : 267 - 284
  • [7] Brain CT registration using hybrid supervised convolutional neural network
    Yuan, Hongmei
    Yang, Minglei
    Qian, Shan
    Wang, Wenxin
    Jia, Xiaotian
    Huang, Feng
    BIOMEDICAL ENGINEERING ONLINE, 2021, 20 (01)
  • [8] Pulmonary CT Registration Through Supervised Learning With Convolutional Neural Networks
    Eppenhof, Koen A. J.
    Pluim, Josien P. W.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (05) : 1097 - 1105
  • [9] Adversarial learning for deformable registration of brain MR image using a multi-scale fully convolutional network
    Duan, Luwen
    Yuan, Gang
    Gong, Lun
    Fu, Tianxiao
    Yang, Xiaodong
    Chen, Xinjian
    Zheng, Jian
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2019, 53
  • [10] A Supervised Image Registration Approach for Late Gadolinium Enhanced MRI and Cine Cardiac MRI Using Convolutional Neural Networks
    Upendra, Roshan Reddy
    Simon, Richard
    Linte, Cristian A.
    MEDICAL IMAGE UNDERSTANDING AND ANALYSIS, 2020, 1248 : 208 - 220