MinimalGAN: diverse medical image synthesis for data augmentation using minimal training data

被引:16
|
作者
Zhang, Yipeng [1 ,2 ,3 ]
Wang, Quan [1 ,2 ]
Hu, Bingliang [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Spectral Imaging Technol, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
[2] Key Lab Biomed Spect Xian, Xian 710119, Shaanxi, Peoples R China
[3] Univ Chinese Acad Sci, Sch Optoelect, Beijing 100190, Peoples R China
关键词
Image generation; Data augmentation; Image segmentation; Medical imaging; DIAGNOSIS;
D O I
10.1007/s10489-022-03609-x
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image synthesis techniques have limited application in the medical field due to unsatisfactory authenticity and precision. Additionally, synthesizing diverse outputs is challenging when the training data are insufficient, as in many medical datasets. In this work, we propose an image-to-image network named the Minimal Generative Adversarial Network (MinimalGAN), to synthesize annotated, accurate, and diverse medical images with minimal training data. The primary concept is to make full use of the internal information of the image and decouple the style from the content by separating them in the self-coding process. After that, the generator is compelled to concentrate on content detail and style separately to synthesize diverse and high-precision images. The proposed MinimalGAN includes two image synthesis techniques; the first is style transfer. We synthesized a stylized retinal fundus dataset. The style transfer deception rate is much higher than that of traditional style transfer methods. The blood vessel segmentation performance increased when only using synthetic data. The other image synthesis technique is target variation. Unlike the traditional translation, rotation, and scaling on the whole image, this approach only performs the above operations on the segmented target being annotated. Experiments demonstrate that segmentation performance improved after utilizing synthetic data.
引用
收藏
页码:3899 / 3916
页数:18
相关论文
共 50 条
  • [41] NeighborMix data augmentation for image recognition
    Feipeng Wang
    Kerong Ben
    Hu Peng
    Meini Yang
    Multimedia Tools and Applications, 2024, 83 : 26581 - 26598
  • [42] DATA AUGMENTATION VIA IMAGE REGISTRATION
    Nalepa, Jakub
    Mrukwa, Grzegorz
    Piechaczek, Szymon
    Lorenzo, Pablo Ribalta
    Marcinkiewicz, Michal
    Bobek-Billewicz, Barbara
    Wawrzyniak, Pawel
    Ulrych, Pawel
    Szymanek, Janusz
    Cwiek, Marcin
    Dudzik, Wojciech
    Kawulok, Michal
    Hayball, Michael P.
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 4250 - 4254
  • [43] Feature transforms for image data augmentation
    Loris Nanni
    Michelangelo Paci
    Sheryl Brahnam
    Alessandra Lumini
    Neural Computing and Applications, 2022, 34 : 22345 - 22356
  • [44] ADAPTIVE DATA AUGMENTATION FOR IMAGE CLASSIFICATION
    Fawzi, Alhussein
    Samulowitz, Horst
    Turaga, Deepak
    Frossard, Pascal
    2016 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2016, : 3688 - 3692
  • [45] Feature transforms for image data augmentation
    Nanni, Loris
    Paci, Michelangelo
    Brahnam, Sheryl
    Lumini, Alessandra
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24) : 22345 - 22356
  • [46] Cross-domain attention-guided generative data augmentation for medical image analysis with limited data
    Xu, Zhenghua
    Tang, Jiaqi
    Qi, Chang
    Yao, Dan
    Liu, Caihua
    Zhan, Yuefu
    Lukasiewicz, Thomas
    COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 168
  • [47] Data Augmentation for Diverse Voice Conversion in Noisy Environments
    Tanna, Avani
    Saxon, Michael
    El Abbadi, Amr
    Wang, William Yang
    INTERSPEECH 2023, 2023, : 2024 - 2025
  • [48] Data Augmentation Using Adversarial Image-to-Image Translation for the Segmentation of Mobile-Acquired Dermatological Images
    Andrade, Catarina
    Teixeira, Luis F.
    Vasconcelos, Maria Joao M.
    Rosado, Luis
    JOURNAL OF IMAGING, 2021, 7 (01)
  • [49] Deep Learning Approaches for Data Augmentation in Medical Imaging: A Review
    Kebaili, Aghiles
    Lapuyade-Lahorgue, Jerome
    Ruan, Su
    JOURNAL OF IMAGING, 2023, 9 (04)
  • [50] Data augmentation for multi-organ detection in medical images
    Hammami, Maryam
    Friboulet, Denis
    Kechichian, Razmig
    2020 TENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2020,