Evaluation of Modern Generative Networks for EchoCG Image Generation

被引:0
作者
Rakhmetulayeva, Sabina [1 ]
Zhanabekov, Zhandos [2 ]
Bolshibayeva, Aigerim [3 ]
机构
[1] Satbayev Univ, Dept Cybersecur Informat Proc & Storage, Alma Ata 050000, Kazakhstan
[2] Int IT Univ, Dept Math Comp Modeling, Alma Ata 050000, Kazakhstan
[3] Int IT Univ, Dept Informat Syst, Alma Ata 050000, Kazakhstan
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 03期
关键词
Synthetic image generation; synthetic echogcardiography; generative adversarial networks; CycleGAN; latent diffusion models; stable diffusion;
D O I
10.32604/cmc.2024.057974
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The applications of machine learning (ML) in the medical domain are often hindered by the limited availability of high-quality data. To address this challenge, we explore the synthetic generation of echocardiography images (echoCG) using state-of-the-art generative models. We conduct a comprehensive evaluation of three prominent and Stable Diffusion 1.5 with Low-Rank Adaptation (LoRA). Our research presents the data generation methodology, image samples, and evaluation strategy, followed by an extensive user study involving licensed cardiologists and surgeons who assess the perceived quality and medical soundness of the generated images. Our findings indicate that Stable Diffusion outperforms both CycleGAN and CUT in generating images that are nearly indistinguishable from real echoCG images, making it a promising tool for augmenting medical datasets. However, we also identify limitations in the synthetic images generated by CycleGAN and CUT, which are easily distinguishable as nonrealistic by medical professionals. This study highlights the potential of diffusion models in medical imaging and their applicability in addressing data scarcity, while also outlining the areas for future improvement.
引用
收藏
页码:4503 / 4523
页数:21
相关论文
共 30 条
  • [11] Liu SY, 2024, Arxiv, DOI arXiv:2402.09353
  • [12] Nie Dong, 2017, Med Image Comput Comput Assist Interv, V10435, P417, DOI 10.1007/978-3-319-66179-7_48
  • [13] Unsupervised Medical Image Translation With Adversarial Diffusion Models
    Ozbey, Muzaffer
    Dalmaz, Onat
    Dar, Salman U. H.
    Bedel, Hasan A.
    Ozturk, Saban
    Gungor, Alper
    Cukur, Tolga
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (12) : 3524 - 3539
  • [14] Park T., 2020, arXiv
  • [15] Podell D, 2023, Arxiv, DOI arXiv:2307.01952
  • [16] Radford A, 2021, PR MACH LEARN RES, V139
  • [17] High-Resolution Image Synthesis with Latent Diffusion Models
    Rombach, Robin
    Blattmann, Andreas
    Lorenz, Dominik
    Esser, Patrick
    Ommer, Bjoern
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 10674 - 10685
  • [18] U-Net: Convolutional Networks for Biomedical Image Segmentation
    Ronneberger, Olaf
    Fischer, Philipp
    Brox, Thomas
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 : 234 - 241
  • [19] ImageNet Large Scale Visual Recognition Challenge
    Russakovsky, Olga
    Deng, Jia
    Su, Hao
    Krause, Jonathan
    Satheesh, Sanjeev
    Ma, Sean
    Huang, Zhiheng
    Karpathy, Andrej
    Khosla, Aditya
    Bernstein, Michael
    Berg, Alexander C.
    Fei-Fei, Li
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) : 211 - 252
  • [20] Salimans T, 2016, ADV NEUR IN, V29