Deformable Image Registration Using a Cue-Aware Deep Regression Network

被引:97
作者
Cao, Xiaohuan [1 ,2 ,3 ]
Yang, Jianhua [1 ]
Zhang, Jun [2 ,3 ]
Wang, Qian [4 ]
Yap, Pew-Thian [2 ,3 ]
Shen, Dinggang [2 ,3 ,5 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Fremont, CA USA
[2] Univ North Carolina Chapel Hill, Dept Radiol, Chapel Hill, NC 27599 USA
[3] Univ North Carolina Chapel Hill, BRIC, Chapel Hill, NC 27599 USA
[4] Shanghai Jiao Tong Univ, Sch Biomed Engn, Inst Med Imaging Technol, Shanghai, Peoples R China
[5] Korea Univ, Dept Brain & Cognit Engn, Seoul 02841, South Korea
基金
中国国家自然科学基金;
关键词
Deformable registration; deep learning; nonlinear regression; key-points sampling; SYMMETRIC DIFFEOMORPHIC REGISTRATION; NONRIGID REGISTRATION; MUTUAL-INFORMATION; MAXIMIZATION; VALIDATION; ALGORITHMS; SEGMENTATION; APPEARANCE; HAMMER; ROBUST;
D O I
10.1109/TBME.2018.2822826
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Significance: Analysis of modern large-scale, multicenter or diseased data requires deformable registration algorithms that can cope with data of diverse nature. Objective: We propose a novel deformable registration method, which is based on a cue-aware deep regression network, to deal with multiple databases with minimal parameter tuning. Methods: Our method learns and predicts the deformation field between a reference image and a subject image. Specifically, given a set of training images, our method learns the displacement vector associated with a pair of reference-subject patches. To achieve this, we first introduce a key-point truncated-balanced sampling strategy to facilitate accurate learning from the image database of limited size. Then, we design a cue-aware deep regression network, where we propose to employ the contextual cue, i.e., the scale-adaptive local similarity, to more apparently guide the learning process. The deep regression network is aware of the contextual cue for accurate prediction of local deformation. Results and Conclusion: Our experiments show that the proposed method can tackle various registration tasks on different databases, giving consistent good performance without the need of manual parameter tuning, which could be applicable to various clinical applications.
引用
收藏
页码:1900 / 1911
页数:12
相关论文
共 54 条
[1]   Quantitative comparison of algorithms for inter-subject registration of 3D volumetric brain MRI scans [J].
Ardekani, BA ;
Guckemus, S ;
Bachman, A ;
Hoptman, MJ ;
Wojtaszek, M ;
Nierenberg, J .
JOURNAL OF NEUROSCIENCE METHODS, 2005, 142 (01) :67-76
[2]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[3]   Computing large deformation metric mappings via geodesic flows of diffeomorphisms [J].
Beg, MF ;
Miller, MI ;
Trouvé, A ;
Younes, L .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 61 (02) :139-157
[4]  
Cao XG, 2016, 2016 INTERNATIONAL CONFERENCE ON DIGITAL IMAGE COMPUTING: TECHNIQUES AND APPLICATIONS (DICTA), P751, DOI 10.1007/978-3-319-46726-9_1
[5]   Dual-core steered non-rigid registration for multi-modal images via bi-directional image synthesis [J].
Cao, Xiaohuan ;
Yang, Jianhua ;
Gao, Yaozong ;
Guo, Yanrong ;
Wu, Guorong ;
Shen, Dinggang .
MEDICAL IMAGE ANALYSIS, 2017, 41 :18-31
[6]   Animal: Validation and applications of nonlinear registration-based segmentation [J].
Collins, DL ;
Evans, AC .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 1997, 11 (08) :1271-1294
[7]   End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Staring, Marius ;
Isgum, Ivana .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :204-212
[8]   Dermatologist-level classification of skin cancer with deep neural networks [J].
Esteva, Andre ;
Kuprel, Brett ;
Novoa, Roberto A. ;
Ko, Justin ;
Swetter, Susan M. ;
Blau, Helen M. ;
Thrun, Sebastian .
NATURE, 2017, 542 (7639) :115-+
[9]   Dense image registration through MRFs and efficient linear programming [J].
Glocker, Ben ;
Komodakis, Nikos ;
Tziritas, Georgios ;
Navab, Nassir ;
Paragios, Nikos .
MEDICAL IMAGE ANALYSIS, 2008, 12 (06) :731-741
[10]   Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs [J].
Gulshan, Varun ;
Peng, Lily ;
Coram, Marc ;
Stumpe, Martin C. ;
Wu, Derek ;
Narayanaswamy, Arunachalam ;
Venugopalan, Subhashini ;
Widner, Kasumi ;
Madams, Tom ;
Cuadros, Jorge ;
Kim, Ramasamy ;
Raman, Rajiv ;
Nelson, Philip C. ;
Mega, Jessica L. ;
Webster, R. .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22) :2402-2410