Unsupervised Medical Image Translation With Adversarial Diffusion Models

被引:131
作者
Ozbey, Muzaffer [1 ,2 ]
Dalmaz, Onat [1 ,2 ]
Dar, Salman U. H. [1 ,2 ]
Bedel, Hasan A. [1 ,2 ]
Ozturk, Saban [1 ,2 ,3 ]
Gungor, Alper [1 ,2 ,4 ]
Cukur, Tolga [1 ,2 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkiye
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkiye
[3] Amasya Univ, Dept Elect Elect Engn, TR-05100 Amasya, Turkiye
[4] SELSAN Res Ctr, TR-06200 Ankara, Turkiye
关键词
Biological system modeling; Computational modeling; Training; Generative adversarial networks; Image synthesis; Task analysis; Generators; Medical image translation; synthesis; unsupervised; unpaired; adversarial; diffusion; generative; ESTIMATING CT IMAGE; RANDOM FOREST; MODALITY; MR;
D O I
10.1109/TMI.2023.3290149
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.
引用
收藏
页码:3524 / 3539
页数:16
相关论文
共 84 条
  • [1] Alexander DC, 2014, LECT NOTES COMPUT SC, V8675, P225, DOI 10.1007/978-3-319-10443-0_29
  • [2] MedGAN: Medical image translation using GANs
    Armanious, Karim
    Jiang, Chenming
    Fischer, Marc
    Kuestner, Thomas
    Nikolaou, Konstantin
    Gatidis, Sergios
    Yang, Bin
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2020, 79
  • [3] Pseudo-healthy Image Synthesis for White Matter Lesion Segmentation
    Bowles, Christopher
    Qin, Chen
    Ledig, Christian
    Guerrero, Ricardo
    Gunn, Roger
    Hammers, Alexander
    Sakka, Eleni
    Dickie, David Alexander
    Hernandez, Maria Valdes
    Royle, Natalie
    Wardlaw, Joanna
    Rhodius-Meester, Hanneke
    Tijms, Betty
    Lemstra, Afina W.
    van der Flier, Wiesje
    Barkhof, Frederik
    Scheltens, Philip
    Rueckert, Daniel
    [J]. SIMULATION AND SYNTHESIS IN MEDICAL IMAGING, SASHIMI 2016, 2016, 9968 : 87 - 96
  • [4] Chartsias Agisilaos, 2017, Simulation and Synthesis in Medical Imaging. Second International Workshop, SASHIMI 2017. Held in Conjunction with MICCAI 2017. Proceedings: LNCS 10557, P3, DOI 10.1007/978-3-319-68127-6_1
  • [5] Multimodal MR Synthesis via Modality-Invariant Latent Representation
    Chartsias, Agisilaos
    Joyce, Thomas
    Giuffrida, Mario Valerio
    Tsaftaris, Sotirios A.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) : 803 - 814
  • [6] Come-Closer-Diffuse-Faster: Accelerating Conditional Diffusion Models for Inverse Problems through Stochastic Contraction
    Chung, Hyungjin
    Sim, Byeongsu
    Ye, Jong Chul
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12403 - 12412
  • [7] Score-based diffusion models for accelerated MRI
    Chung, Hyungjin
    Ye, Jong Chul
    [J]. MEDICAL IMAGE ANALYSIS, 2022, 80
  • [8] Chung Hyungjin, 2022, arXiv
  • [9] Extended Modality Propagation: Image Synthesis of Pathological Cases
    Cordier, Nicolas
    Delingette, Herve
    Le, Matthieu
    Ayache, Nicholas
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (12) : 2598 - 2608
  • [10] ResViT: Residual Vision Transformers for Multimodal Medical Image Synthesis
    Dalmaz, Onat
    Yurt, Mahmut
    Cukur, Tolga
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (10) : 2598 - 2614