Unsupervised Multi-Modal Medical Image Registration via Discriminator-Free Image-to-Image Translation

被引:0
作者
Chen, Zekang [1 ]
Wei, Jia [1 ]
Li, Rui [2 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou, Peoples R China
[2] Rochester Inst Technol, Golisano Coll Comp & Informat Sci, Rochester, NY 14623 USA
来源
PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022 | 2022年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In clinical practice, well-aligned multi-modal images, such as Magnetic Resonance (MR) and Computed Tomography (CT), together can provide complementary information for image-guided therapies. Multi-modal image registration is essential for the accurate alignment of these multi-modal images. However, it remains a very challenging task due to complicated and unknown spatial correspondence between different modalities. In this paper, we propose a novel translation-based unsupervised deformable image registration approach to convert the multi-modal registration problem to a mono-modal one. Specifically, our approach incorporates a discriminator-free translation network to facilitate the training of the registration network and a patchwise contrastive loss to encourage the translation network to preserve object shapes. Furthermore, we propose to replace an adversarial loss, that is widely used in previous multi-modal image registration methods, with a pixel loss in order to integrate the output of translation into the target modality. This leads to an unsupervised method requiring no ground-truth deformation or pairs of aligned images for training. We evaluate four variants of our approach on the public Learn2Reg 2021 datasets [Hering et al., 2021]. The experimental results demonstrate that the proposed architecture achieves state-of-the-art performance. Our code is available at https://github.com/heyblackC/DFMIR.
引用
收藏
页码:834 / 840
页数:7
相关论文
共 25 条
  • [1] Unsupervised Multi-Modal Image Registration via Geometry Preserving Image-to-Image Translation
    Arar, Moab
    Ginger, Yiftach
    Danon, Dov
    Bermano, Amit H.
    Cohen-Or, Daniel
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 13407 - 13416
  • [2] VoxelMorph: A Learning Framework for Deformable Medical Image Registration
    Balakrishnan, Guha
    Zhao, Amy
    Sabuncu, Mert R.
    Guttag, John
    Dalca, Adrian, V
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (08) : 1788 - 1800
  • [3] Synth-by-Reg (SbR): Contrastive Learning for Synthesis-Based Registration of Paired Images
    Casamitjana, Adria
    Mancini, Matteo
    Iglesias, Juan Eugenio
    [J]. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2021, 2021, 12965 : 44 - 54
  • [4] End-to-End Unsupervised Deformable Image Registration with a Convolutional Neural Network
    de Vos, Bob D.
    Berendsen, Floris F.
    Viergever, Max A.
    Staring, Marius
    Isgum, Ivana
    [J]. DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 : 204 - 212
  • [5] MEASURES OF THE AMOUNT OF ECOLOGIC ASSOCIATION BETWEEN SPECIES
    DICE, LR
    [J]. ECOLOGY, 1945, 26 (03) : 297 - 302
  • [6] Adversarial learning for mono- or multi-modal registration
    Fan, Jingfan
    Cao, Xiaohuan
    Wang, Qian
    Yap, Pew-Thian
    Shen, Dinggang
    [J]. MEDICAL IMAGE ANALYSIS, 2019, 58
  • [7] MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration
    Heinrich, Mattias P.
    Jenkinson, Mark
    Bhushan, Manav
    Matin, Tahreema
    Gleeson, Fergus V.
    Brady, Sir Michael
    Schnabel, Julia A.
    [J]. MEDICAL IMAGE ANALYSIS, 2012, 16 (07) : 1423 - 1435
  • [8] Hering A, 2021, Arxiv, DOI arXiv:2112.04489
  • [9] HyperMorph: Amortized Hyperparameter Learning for Image Registration
    Hoopes, Andrew
    Hoffmann, Malte
    Fischl, Bruce
    Guttag, John
    Dalca, Adrian V.
    [J]. INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2021, 2021, 12729 : 3 - 17
  • [10] Weakly-supervised convolutional neural networks for multimodal image registration
    Hu, Yipeng
    Modat, Marc
    Gibson, Eli
    Li, Wenqi
    Ghavamia, Nooshin
    Bonmati, Ester
    Wang, Guotai
    Bandula, Steven
    Moore, Caroline M.
    Emberton, Mark
    Ourselin, Sebastien
    Noble, J. Alison
    Barratt, Dean C.
    Vercauteren, Tom
    [J]. MEDICAL IMAGE ANALYSIS, 2018, 49 : 1 - 13