BIRNet: Brain image registration using dual-supervised fully convolutional networks

被引:192
|
作者
Fan, Jingfan [1 ,2 ,3 ]
Cao, Xiaohuan [4 ]
Yap, Pew-Thian [1 ,2 ]
Shen, Dinggang [1 ,2 ,5 ]
机构
[1] Univ N Carolina, Dept Radiol, Chapel Hill, NC 27515 USA
[2] Univ N Carolina, BRIC, Chapel Hill, NC 27515 USA
[3] Beijing Inst Technol, Sch Opt & Photon, Beijing Engn Res Ctr Mixed Real & Adv Display, Beijing, Peoples R China
[4] Shanghai United Imaging Intelligence Co Ltd, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul, South Korea
关键词
Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration; SYMMETRIC DIFFEOMORPHIC REGISTRATION; CONSTRUCTION; ROBUST; ATLAS; APPEARANCE; HAMMER;
D O I
10.1016/j.media.2019.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:193 / 206
页数:14
相关论文
共 50 条
  • [31] Impact of fully connected layers on performance of convolutional neural networks for image classification
    Basha, S. H. Shabbeer
    Dubey, Shiv Ram
    Pulabaigari, Viswanath
    Mukherjee, Snehasis
    NEUROCOMPUTING, 2020, 378 (378) : 112 - 119
  • [32] AUTOMATIC SKIN AND HAIR MASKING USING FULLY CONVOLUTIONAL NETWORKS
    Qin, Siyang
    Kim, Seongdo
    Manduchi, Roberto
    2017 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2017, : 103 - 108
  • [33] A Fully-Blind and Fast Image Quality Predictor with Convolutional Neural Networks
    Cheng, Zhengxue
    Takeuchi, Masaru
    Kanai, Kenji
    Katto, Jiro
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2018, E101A (09) : 1557 - 1566
  • [34] Fully-Automated Segmentation of Nasopharyngeal Carcinoma on Dual-Sequence MRI Using Convolutional Neural Networks
    Ye, Yufeng
    Cai, Zongyou
    Huang, Bin
    He, Yan
    Zeng, Ping
    Zou, Guorong
    Deng, Wei
    Chen, Hanwei
    Huang, Bingsheng
    FRONTIERS IN ONCOLOGY, 2020, 10
  • [35] A Fast Brain Image Registration Using Axial Transformation
    Kanakaraj, Sithara
    Govindan, V. K.
    Pournami, P. N.
    WIRELESS NETWORKS AND COMPUTATIONAL INTELLIGENCE, ICIP 2012, 2012, 292 : 206 - 212
  • [36] Image Registration using neural networks as a shape discriminator
    Ontman, Aleks Y. M.
    Shiflet, Gary J.
    TMS 2008 ANNUAL MEETING SUPPLEMENTAL PROCEEDINGS, VOL 2: MATERIALS CHARACTERIZATION, COMPUTATION AND MODELING, 2008, : 155 - 160
  • [37] Learning Iterative Optimisation for Deformable Image Registration of Lung CT with Recurrent Convolutional Networks
    Falta, Fenja
    Hansen, Lasse
    Heinrich, Mattias P.
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 301 - 309
  • [38] A fast and scalable method for quality assurance of deformable image registration on lung CT scans using convolutional neural networks
    Galib, Shaikat M.
    Lee, Hyoung K.
    Guy, Christopher L.
    Riblett, Matthew J.
    Hugo, Geoffrey D.
    MEDICAL PHYSICS, 2020, 47 (01) : 99 - 109
  • [39] Image spam filtering using convolutional neural networks
    Fan Aiwan
    Yang Zhaofeng
    PERSONAL AND UBIQUITOUS COMPUTING, 2018, 22 (5-6) : 1029 - 1037
  • [40] Image spam filtering using convolutional neural networks
    Fan Aiwan
    Yang Zhaofeng
    Personal and Ubiquitous Computing, 2018, 22 : 1029 - 1037