Robust Deformable Image Registration Using Cycle-Consistent Implicit Representations

被引:2
作者
van Harten, Louis D. [1 ,2 ]
Stoker, Jaap [3 ,4 ,5 ]
Isgum, Ivana [2 ,6 ,7 ]
机构
[1] Amsterdam UMC Locat Univ Amsterdam, Dept Biomed Engn & Phys, NL-1105 AZ Amsterdam, Netherlands
[2] Univ Amsterdam, Informat Inst, NL-1098 XH Amsterdam, Netherlands
[3] Amsterdam UMC Locat Univ Amsterdam, Dept Radiol & Nucl Med, NL-1105 AZ Amsterdam, Netherlands
[4] Amsterdam Gastroenterol Endocrinol Metab, NL-1105 AZ Amsterdam, Netherlands
[5] Canc Ctr Amsterdam, NL-1080 HV Amsterdam, Netherlands
[6] Amsterdam UMC Locat Univ Amsterdam, Dept Biomed Engn, NL-1105 AZ Amsterdam, Netherlands
[7] Amsterdam UMC Locat Univ Amsterdam, Dept Radiol & Nucl Med, NL-1105 AZ Amsterdam, Netherlands
关键词
Deformable image registration; implicit neural representations; quality control; regularization; LEARNING FRAMEWORK; MOTION;
D O I
10.1109/TMI.2023.3321425
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Recent works in medical image registration have proposed the use of Implicit Neural Representations, demonstrating performance that rivals state-of-the-art learning-based methods. However, these implicit representations need to be optimized for each new image pair, which is a stochastic process that may fail to converge to a global minimum. To improve robustness, we propose a deformable registration method using pairs of cycle-consistent Implicit Neural Representations: each implicit representation is linked to a second implicit representation that estimates the opposite transformation, causing each network to act as a regularizer for its paired opposite. During inference, we generate multiple deformation estimates by numerically inverting the paired backward transformation and evaluating the consensus of the optimized pair. This consensus improves registration accuracy over using a single representation and results in a robust uncertainty metric that can be used for automatic quality control. We evaluate our method with a 4D lung CT dataset. The proposed cycle-consistent optimization method reduces the optimization failure rate from 2.4% to 0.0% compared to the current state-of-the-art. The proposed inference method improves landmark accuracy by 4.5% and the proposed uncertainty metric detects all instances where the registration method fails to converge to a correct solution. We verify the generalizability of these results to other data using a centerline propagation task in abdominal 4D MRI, where our method achieves a 46% improvement in propagation consistency compared with single-INR registration and demonstrates a strong correlation between the proposed uncertainty metric and registration accuracy.
引用
收藏
页码:784 / 793
页数:10
相关论文
共 33 条
  • [1] VoxelMorph: A Learning Framework for Deformable Medical Image Registration
    Balakrishnan, Guha
    Zhao, Amy
    Sabuncu, Mert R.
    Guttag, John
    Dalca, Adrian, V
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) : 1788 - 1800
  • [2] Meta-registration: Learning Test-Time Optimization for Single-Pair Image Registration
    Baum, Zachary M. C.
    Hu, Yipeng
    Barratt, Dean C.
    [J]. SIMPLIFYING MEDICAL ULTRASOUND, ASMUS 2022, 2022, 13565 : 162 - 171
  • [3] Berendsen A. N. T. J., 2014, Medical Imaging 2014: Image Processing, V9034, P95
  • [4] Assessment by a deformable registration method of the volumetric and positional changes of target volumes and organs at risk in pharyngo-laryngeal tumors treated with concomitant chemo-radiation
    Castadot, Pierre
    Geets, Xavier
    Lee, John Aldo
    Christian, Nicolas
    Gregoire, Vincent
    [J]. RADIOTHERAPY AND ONCOLOGY, 2010, 95 (02) : 209 - 217
  • [5] A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets
    Castillo, Richard
    Castillo, Edward
    Guerra, Rudy
    Johnson, Valen E.
    McPhail, Travis
    Garg, Amit K.
    Guerrero, Thomas
    [J]. PHYSICS IN MEDICINE AND BIOLOGY, 2009, 54 (07) : 1849 - 1870
  • [6] Consistent image registration
    Christensen, GE
    Johnson, HJ
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2001, 20 (07) : 568 - 582
  • [7] Evaluation of gastrointestinal motility with MRI: Advances, challenges and opportunities
    de Jonge, C. S.
    Smout, A. J. P. M.
    Nederveen, A. J.
    Stoker, J.
    [J]. NEUROGASTROENTEROLOGY AND MOTILITY, 2018, 30 (01)
  • [8] Detecting the effects of a standardized meal challenge on small bowel motility with MRI in prepared and unprepared bowel
    de Jonge, Catharina S.
    Menys, Alex
    van Rijn, Kyra L.
    Bredenoord, Arjan J.
    Nederyeen, Aart J.
    Stoker, Jaap
    [J]. NEUROGASTROENTEROLOGY AND MOTILITY, 2019, 31 (02)
  • [9] Mutual Information for Unsupervised Deep Learning Image Registration
    de Vos, Bob D.
    van der Velden, Bas
    Sander, Jorg
    Gilhuijs, Kenneth
    Staring, Marius
    Isgum, Ivana
    [J]. MEDICAL IMAGING 2020: IMAGE PROCESSING, 2021, 11313
  • [10] A deep learning framework for unsupervised affine and deformable image registration
    de Vos, Bob D.
    Berendsen, Floris F.
    Viergever, Max A.
    Sokooti, Hessam
    Staring, Marius
    Isgum, Ivana
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 52 : 128 - 143