Deformable Image Registration Using a Cue-Aware Deep Regression Network

被引:93
作者
Cao, Xiaohuan [1 ,2 ,3 ]
Yang, Jianhua [1 ]
Zhang, Jun [2 ,3 ]
Wang, Qian [4 ]
Yap, Pew-Thian [2 ,3 ]
Shen, Dinggang [2 ,3 ,5 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Fremont, CA USA
[2] Univ North Carolina Chapel Hill, Dept Radiol, Chapel Hill, NC 27599 USA
[3] Univ North Carolina Chapel Hill, BRIC, Chapel Hill, NC 27599 USA
[4] Shanghai Jiao Tong Univ, Sch Biomed Engn, Inst Med Imaging Technol, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Deformable registration; deep learning; nonlinear regression; key-points sampling; SYMMETRIC DIFFEOMORPHIC REGISTRATION; NONRIGID REGISTRATION; MUTUAL-INFORMATION; MAXIMIZATION; VALIDATION; ALGORITHMS; SEGMENTATION; APPEARANCE; HAMMER; ROBUST;
D O I
10.1109/TBME.2018.2822826
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Significance: Analysis of modern large-scale, multicenter or diseased data requires deformable registration algorithms that can cope with data of diverse nature. Objective: We propose a novel deformable registration method, which is based on a cue-aware deep regression network, to deal with multiple databases with minimal parameter tuning. Methods: Our method learns and predicts the deformation field between a reference image and a subject image. Specifically, given a set of training images, our method learns the displacement vector associated with a pair of reference-subject patches. To achieve this, we first introduce a key-point truncated-balanced sampling strategy to facilitate accurate learning from the image database of limited size. Then, we design a cue-aware deep regression network, where we propose to employ the contextual cue, i.e., the scale-adaptive local similarity, to more apparently guide the learning process. The deep regression network is aware of the contextual cue for accurate prediction of local deformation. Results and Conclusion: Our experiments show that the proposed method can tackle various registration tasks on different databases, giving consistent good performance without the need of manual parameter tuning, which could be applicable to various clinical applications.
引用
收藏
页码:1900 / 1911
页数:12
相关论文
共 54 条
  • [1] Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans
    Ardekani, BA
    Guckemus, S
    Bachman, A
    Hoptman, MJ
    Wojtaszek, M
    Nierenberg, J
    [J]. JOURNAL OF NEUROSCIENCE METHODS, 2005, 142 (01) : 67 - 76
  • [2] Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain
    Avants, B. B.
    Epstein, C. L.
    Grossman, M.
    Gee, J. C.
    [J]. MEDICAL IMAGE ANALYSIS, 2008, 12 (01) : 26 - 41
  • [3] Computing large deformation metric mappings via geodesic flows of diffeomorphisms
    Beg, MF
    Miller, MI
    Trouvé, A
    Younes, L
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 61 (02) : 139 - 157
  • [4] Cao XG, 2016, 2016 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), P751, DOI 10.1007/978-3-319-46726-9_1
  • [5] Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis
    Cao, Xiaohuan
    Yang, Jianhua
    Gao, Yaozong
    Guo, Yanrong
    Wu, Guorong
    Shen, Dinggang
    [J]. MEDICAL IMAGE ANALYSIS, 2017, 41 : 18 - 31
  • [6] Animal: Validation and applications of nonlinear registration-based segmentation
    Collins, DL
    Evans, AC
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1997, 11 (08) : 1271 - 1294
  • [7] End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
    de Vos, Bob D.
    Berendsen, Floris F.
    Viergever, Max A.
    Staring, Marius
    Isgum, Ivana
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 : 204 - 212
  • [8] Dermatologist-level classification of skin cancer with deep neural networks
    Esteva, Andre
    Kuprel, Brett
    Novoa, Roberto A.
    Ko, Justin
    Swetter, Susan M.
    Blau, Helen M.
    Thrun, Sebastian
    [J]. NATURE, 2017, 542 (7639) : 115 - +
  • [9] Dense image registration through MRFs and efficient linear programming
    Glocker, Ben
    Komodakis, Nikos
    Tziritas, Georgios
    Navab, Nassir
    Paragios, Nikos
    [J]. MEDICAL IMAGE ANALYSIS, 2008, 12 (06) : 731 - 741
  • [10] Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs
    Gulshan, Varun
    Peng, Lily
    Coram, Marc
    Stumpe, Martin C.
    Wu, Derek
    Narayanaswamy, Arunachalam
    Venugopalan, Subhashini
    Widner, Kasumi
    Madams, Tom
    Cuadros, Jorge
    Kim, Ramasamy
    Raman, Rajiv
    Nelson, Philip C.
    Mega, Jessica L.
    Webster, R.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22): : 2402 - 2410