Evaluation of Modern Generative Networks for EchoCG Image Generation

被引:0
作者
Rakhmetulayeva, Sabina [1 ]
Zhanabekov, Zhandos [2 ]
Bolshibayeva, Aigerim [3 ]
机构
[1] Satbayev Univ, Dept Cybersecur Informat Proc & Storage, Alma Ata 050000, Kazakhstan
[2] Int IT Univ, Dept Math Comp Modeling, Alma Ata 050000, Kazakhstan
[3] Int IT Univ, Dept Informat Syst, Alma Ata 050000, Kazakhstan
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 03期
关键词
Synthetic image generation; synthetic echogcardiography; generative adversarial networks; CycleGAN; latent diffusion models; stable diffusion;
D O I
10.32604/cmc.2024.057974
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The applications of machine learning (ML) in the medical domain are often hindered by the limited availability of high-quality data. To address this challenge, we explore the synthetic generation of echocardiography images (echoCG) using state-of-the-art generative models. We conduct a comprehensive evaluation of three prominent and Stable Diffusion 1.5 with Low-Rank Adaptation (LoRA). Our research presents the data generation methodology, image samples, and evaluation strategy, followed by an extensive user study involving licensed cardiologists and surgeons who assess the perceived quality and medical soundness of the generated images. Our findings indicate that Stable Diffusion outperforms both CycleGAN and CUT in generating images that are nearly indistinguishable from real echoCG images, making it a promising tool for augmenting medical datasets. However, we also identify limitations in the synthetic images generated by CycleGAN and CUT, which are easily distinguishable as nonrealistic by medical professionals. This study highlights the potential of diffusion models in medical imaging and their applicability in addressing data scarcity, while also outlining the areas for future improvement.
引用
收藏
页码:4503 / 4523
页数:21
相关论文
共 30 条
  • [1] Blattmann A, 2023, Arxiv, DOI arXiv:2311.15127
  • [2] Effectively Unbiased FID and Inception Score and where to find them
    Chong, Min Jin
    Forsyth, David
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6069 - 6078
  • [3] Dhariwal P, 2021, ADV NEUR IN, V34
  • [4] Generating Synthetic Labeled Data From Existing Anatomical Models: An Example With Echocardiography Segmentation
    Gilbert, Andrew
    Marciniak, Maciej
    Rodero, Cristobal
    Lamata, Pablo
    Samset, Eigil
    Mcleod, Kristin
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) : 2783 - 2794
  • [5] Heusel M, 2017, ADV NEUR IN, V30
  • [6] Ho J., 2020, P 34 INT C NEUR INF
  • [7] Hu EJ, 2021, Arxiv, DOI arXiv:2106.09685
  • [8] Isola P, 2018, Arxiv, DOI arXiv:1611.07004
  • [9] Diffusion Deformable Model for 4D Temporal Medical Image Generation
    Kim, Boah
    Ye, Jong Chul
    [J]. MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT I, 2022, 13431 : 539 - 548
  • [10] Singh NK, 2020, Arxiv, DOI [arXiv:2005.10687, DOI 10.48550/ARXIV.2005.10687]