Adversarial Data Augmentation on Breast MRI Segmentation

被引:4
作者
Teixeira, Joao E. [1 ,2 ]
Dias, Mariana [1 ]
Batista, Eva [3 ]
Costa, Joana [3 ]
Teixeira, Luis E. [1 ,2 ]
Oliveira, Helder P. [1 ,4 ]
机构
[1] INESC TEC, P-4200465 Porto, Portugal
[2] Univ Porto, Fac Engn, P-4099002 Porto, Portugal
[3] Champalimaud Fdn, Champalimaud Clin Ctr, Breast Unit, P-1400038 Lisbon, Portugal
[4] Univ Porto, Fac Sci, P-4099002 Porto, Portugal
来源
APPLIED SCIENCES-BASEL | 2021年 / 11卷 / 10期
关键词
breast; semantic segmentation; generation; MRI; label map; data augmentation; synthetic data; generative adversarial network; U-Net;
D O I
10.3390/app11104554
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The scarcity of balanced and annotated datasets has been a recurring problem in medical image analysis. Several researchers have tried to fill this gap employing dataset synthesis with adversarial networks (GANs). Breast magnetic resonance imaging (MRI) provides complex, texture-rich medical images, with the same annotation shortage issues, for which, to the best of our knowledge, no previous work tried synthesizing data. Within this context, our work addresses the problem of synthesizing breast MRI images from corresponding annotations and evaluate the impact of this data augmentation strategy on a semantic segmentation task. We explored variations of image-to-image translation using conditional GANs, namely fitting the generator's architecture with residual blocks and experimenting with cycle consistency approaches. We studied the impact of these changes on visual verisimilarity and how an U-Net segmentation model is affected by the usage of synthetic data. We achieved sufficiently realistic-looking breast MRI images and maintained a stable segmentation score even when completely replacing the dataset with the synthetic set. Our results were promising, especially when concerning to Pix2PixHD and Residual CycleGAN architectures.
引用
收藏
页数:23
相关论文
共 33 条
  • [1] Alexandre M., UNET SEMANTIC SEGMEN
  • [2] [Anonymous], 2016, P NIPS
  • [3] [Anonymous], 2018, ARXIV181211440
  • [4] [Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.90
  • [5] [Anonymous], 2017, P 31 ADV NEUR INF PR
  • [6] MedGAN: Medical image translation using GANs
    Armanious, Karim
    Jiang, Chenming
    Fischer, Marc
    Kuestner, Thomas
    Nikolaou, Konstantin
    Gatidis, Sergios
    Yang, Bin
    [J]. COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2020, 79
  • [7] Optimization with Soft Dice Can Lead to a Volumetric Bias
    Bertels, Jeroen
    Robben, David
    Vandermeulen, Dirk
    Suetens, Paul
    [J]. BRAINLESION: GLIOMA, MULTIPLE SCLEROSIS, STROKE AND TRAUMATIC BRAIN INJURIES (BRAINLES 2019), PT I, 2020, 11992 : 89 - 97
  • [8] Pros and cons of GAN evaluation measures
    Borji, Ali
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 179 : 41 - 65
  • [9] Multimodal MR Synthesis via Modality-Invariant Latent Representation
    Chartsias, Agisilaos
    Joyce, Thomas
    Giuffrida, Mario Valerio
    Tsaftaris, Sotirios A.
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) : 803 - 814
  • [10] End-to-End Adversarial Retinal Image Synthesis
    Costa, Pedro
    Galdran, Adrian
    Meyer, Maria Ines
    Niemeijer, Meindert
    Abramoff, Michael
    Mendonca, Ana Maria
    Campilho, Aurelio
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) : 781 - 791