CycleMorph: Cycle consistent unsupervised deformable image registration

被引:205
作者
Kim, Boah [1 ]
Kim, Dong Hwan [2 ]
Park, Seong Ho [3 ,4 ]
Kim, Jieun [5 ]
Lee, June-Goo [6 ]
Ye, Jong Chul [1 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Dept Bio & Brain Engn, Daejeon, South Korea
[2] Catholic Univ Korea, Coll Med, Seoul St Marys Hosp, Dept Radiol, Seoul, South Korea
[3] Univ Ulsan, Coll Med, Asan Med Ctr, Dept Radiol, Seoul, South Korea
[4] Univ Ulsan, Coll Med, Asan Med Ctr, Res Inst Radiol, Seoul, South Korea
[5] Korea Automot Technol Inst KATECH, Smart Car R&D Div, AI Bigdata R&D Ctr, Cheonan, South Korea
[6] Univ Ulsan, Coll Med, Asan Med Inst Convergence Sci & Technol, Asan Med Ctr,Dept Convergence Med, Seoul, South Korea
关键词
Cycle consistency; Image registration; Deep learning; Unsupervised learning; LEARNING FRAMEWORK;
D O I
10.1016/j.media.2021.102036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image registration is a fundamental task in medical image analysis. Recently, many deep learning based image registration methods have been extensively investigated due to their comparable performance with the state-of-the-art classical approaches despite the ultra-fast computational time. However, the existing deep learning methods still have limitations in the preservation of original topology during the deformation with registration vector fields. To address this issues, here we present a cycle-consistent de formable image registration, dubbed CycleMorph. The cycle consistency enhances image registration performance by providing an implicit regularization to preserve topology during the deformation. The proposed method is so flexible that it can be applied for both 2D and 3D registration problems for various applications, and can be easily extended to multi-scale implementation to deal with the memory issues in large volume registration. Experimental results on various datasets from medical and non-medical applications demonstrate that the proposed method provides effective and accurate registration on diverse image pairs within a few seconds. Qualitative and quantitative evaluations on deformation fields also verify the effectiveness of the cycle consistency of the proposed method. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 36 条
[11]   Multi-contrast large deformation diffeomorphic metric mapping for diffusion tensor imaging [J].
Ceritoglu, Can ;
Oishi, Kenichi ;
Li, Xin ;
Chou, Ming-Chung ;
Younes, Laurent ;
Albert, Marilyn ;
Lyketsos, Constantine ;
van Zijl, Peter C. M. ;
Miller, Michael I. ;
Mori, Susumu .
NEUROIMAGE, 2009, 47 (02) :618-627
[12]   Consistent image registration [J].
Christensen, GE ;
Johnson, HJ .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2001, 20 (07) :568-582
[13]   Unsupervised Learning for Fast Probabilistic Diffeomorphic Registration [J].
Dalca, Adrian V. ;
Balakrishnan, Guha ;
Guttag, John ;
Sabuncu, Mert R. .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :729-738
[14]   A deep learning framework for unsupervised affine and deformable image registration [J].
de Vos, Bob D. ;
Berendsen, Floris F. ;
Viergever, Max A. ;
Sokooti, Hessam ;
Staring, Marius ;
Isgum, Ivana .
MEDICAL IMAGE ANALYSIS, 2019, 52 :128-143
[15]   Adversarial Similarity Network for Evaluating Image Alignment in Deep Learning Based Registration [J].
Fan, Jingfan ;
Cao, Xiaohuan ;
Xue, Zhong ;
Yap, Pew-Thian ;
Shen, Dinggang .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :739-746
[16]   FreeSurfer [J].
Fischl, Bruce .
NEUROIMAGE, 2012, 62 (02) :774-781
[17]  
Goodfellow I, 2020, P ADV NEUR INF PROC, V63, P139, DOI DOI 10.1145/3422622
[18]  
Jaderberg M, 2015, ADV NEUR IN, V28
[19]   Unsupervised Deformable Image Registration Using Cycle-Consistent CNN [J].
Kim, Boah ;
Kim, Jieun ;
Lee, June-Goo ;
Kim, Dong Hwan ;
Park, Seong Ho ;
Ye, Jong Chul .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 :166-174
[20]   Assessment of the treatment response of HCC [J].
Kim, Kyung Won ;
Lee, Jeong Min ;
Choi, Byung Ihn .
ABDOMINAL IMAGING, 2011, 36 (03) :300-314