BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [21] Dual and Single Polarized SAR Image Classification Using Compact Convolutional Neural Networks
    Ahishali, Mete
    Kiranyaz, Serkan
    Ince, Turker
    Gabbouj, Moncef
    REMOTE SENSING, 2019, 11 (11)
  • [22] MSFCN-multiple supervised fully convolutional networks for the osteosarcoma segmentation of CT images
    Huang, Lin
    Xia, Wei
    Zhang, Bo
    Qiu, Bensheng
    Gao, Xin
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2017, 143 : 67 - 74
  • [23] Microaneurysm detection using fully convolutional neural networks
    Chudzik, Piotr
    Majumdar, Somshubra
    Caliva, Francesco
    Al-Diri, Bashir
    Hunter, Andrew
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2018, 158 : 185 - 192
  • [24] Detection of roadside vegetation using Fully Convolutional Networks
    Harbas, Iva
    Prentasic, Pavle
    Subasic, Marko
    IMAGE AND VISION COMPUTING, 2018, 74 : 1 - 9
  • [25] Brain CT and MRI medical image fusion using convolutional neural networks and a dual-channel spiking cortical model
    Ruichao Hou
    Dongming Zhou
    Rencan Nie
    Dong Liu
    Xiaoli Ruan
    Medical & Biological Engineering & Computing, 2019, 57 : 887 - 900
  • [26] ORCHESTRAL FULLY CONVOLUTIONAL NETWORKS FOR SMALL LESION SEGMENTATION IN BRAIN MRI
    Xu, Botian
    Chai, Yaqiong
    Galarza, Cristina M.
    Vu, Chau Q.
    Tamrazi, Benita
    Gaonkar, Bilwaj
    Macyszyn, Luke
    Coates, Thomas D.
    Lepore, Natasha
    Wood, John C.
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 889 - 892
  • [27] Unsupervised Histological Image Registration Using Structural Feature Guided Convolutional Neural Network
    Ge, Lin
    Wei, Xingyue
    Hao, Yayu
    Luo, Jianwen
    Xu, Yan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (09) : 2414 - 2431
  • [28] Video Captioning Using Weakly Supervised Convolutional Neural Networks
    Flaute, Dylan
    Narayanan, Barath Narayanan
    APPLICATIONS OF MACHINE LEARNING 2020, 2020, 11511
  • [29] Progressively Growing Convolutional Networks for End-to-End Deformable Image Registration
    Eppenhof, Koen A. J.
    Lafarge, Maxime W.
    Pluim, Josien P. W.
    MEDICAL IMAGING 2019: IMAGE PROCESSING, 2019, 10949
  • [30] Linear and Deformable Image Registration with 3D Convolutional Neural Networks
    Stergios, Christodoulidis
    Mihir, Sahasrabudhe
    Maria, Vakalopoulou
    Guillaume, Chassagnon
    Marie-Pierre, Revel
    Stavroula, Mougiakakou
    Nikos, Paragios
    IMAGE ANALYSIS FOR MOVING ORGAN, BREAST, AND THORACIC IMAGES, 2018, 11040 : 13 - 22