CycleMorph: Cycle consistent unsupervised deformable image registration

被引:205
作者
Kim, Boah [1 ]
Kim, Dong Hwan [2 ]
Park, Seong Ho [3 ,4 ]
Kim, Jieun [5 ]
Lee, June-Goo [6 ]
Ye, Jong Chul [1 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Dept Bio & Brain Engn, Daejeon, South Korea
[2] Catholic Univ Korea, Coll Med, Seoul St Marys Hosp, Dept Radiol, Seoul, South Korea
[3] Univ Ulsan, Coll Med, Asan Med Ctr, Dept Radiol, Seoul, South Korea
[4] Univ Ulsan, Coll Med, Asan Med Ctr, Res Inst Radiol, Seoul, South Korea
[5] Korea Automot Technol Inst KATECH, Smart Car R&D Div, AI Bigdata R&D Ctr, Cheonan, South Korea
[6] Univ Ulsan, Coll Med, Asan Med Inst Convergence Sci & Technol, Asan Med Ctr,Dept Convergence Med, Seoul, South Korea
关键词
Cycle consistency; Image registration; Deep learning; Unsupervised learning; LEARNING FRAMEWORK;
D O I
10.1016/j.media.2021.102036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image registration is a fundamental task in medical image analysis. Recently, many deep learning based image registration methods have been extensively investigated due to their comparable performance with the state-of-the-art classical approaches despite the ultra-fast computational time. However, the existing deep learning methods still have limitations in the preservation of original topology during the deformation with registration vector fields. To address this issues, here we present a cycle-consistent de formable image registration, dubbed CycleMorph. The cycle consistency enhances image registration performance by providing an implicit regularization to preserve topology during the deformation. The proposed method is so flexible that it can be applied for both 2D and 3D registration problems for various applications, and can be easily extended to multi-scale implementation to deal with the memory issues in large volume registration. Experimental results on various datasets from medical and non-medical applications demonstrate that the proposed method provides effective and accurate registration on diverse image pairs within a few seconds. Qualitative and quantitative evaluations on deformation fields also verify the effectiveness of the cycle consistency of the proposed method. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 36 条
[1]   A fast diffeomorphic image registration algorithm [J].
Ashburner, John .
NEUROIMAGE, 2007, 38 (01) :95-113
[2]   Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain [J].
Avants, B. B. ;
Epstein, C. L. ;
Grossman, M. ;
Gee, J. C. .
MEDICAL IMAGE ANALYSIS, 2008, 12 (01) :26-41
[3]   A reproducible evaluation of ANTs similarity metric performance in brain image registration [J].
Avants, Brian B. ;
Tustison, Nicholas J. ;
Song, Gang ;
Cook, Philip A. ;
Klein, Arno ;
Gee, James C. .
NEUROIMAGE, 2011, 54 (03) :2033-2044
[4]  
Ayache N., 2018, ARXIV PREPRINT ARXIV
[5]   VoxelMorph: A Learning Framework for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian, V .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) :1788-1800
[6]   An Unsupervised Learning Model for Deformable Medical Image Registration [J].
Balakrishnan, Guha ;
Zhao, Amy ;
Sabuncu, Mert R. ;
Guttag, John ;
Dalca, Adrian V. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :9252-9260
[7]   Computing large deformation metric mappings via geodesic flows of diffeomorphisms [J].
Beg, MF ;
Miller, MI ;
Trouvé, A ;
Younes, L .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2005, 61 (02) :139-157
[8]  
Cao X., 2018, ARXIV PREPRINT ARXIV
[9]  
Cao Xiaohuan, 2017, Med Image Comput Comput Assist Interv, V10433, P300, DOI 10.1007/978-3-319-66182-7_35
[10]   Large deformation diffeomorphic metric mapping of vector fields [J].
Cao, Y ;
Miller, MI ;
Winslow, RL ;
Younes, L .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2005, 24 (09) :1216-1230