Power-law spectrum-based objective function to train a generative adversarial network with transfer learning for the synthetic breast CT image

被引:0
作者
Kim, Gihun [1 ]
Baek, Jongduk [2 ,3 ]
机构
[1] Yonsei Univ, Sch Integrated Technol, Seoul, South Korea
[2] Yonsei Univ, Dept Artificial Intelligence, Seoul, South Korea
[3] Baruenex Imaging, Daejeon, South Korea
基金
新加坡国家研究基金会;
关键词
breast phantom; breast CT; GAN; generative model; power-law spectrum; SOFTWARE PHANTOM; HUMAN-OBSERVER; MODEL; PERFORMANCE; NOISE; DETECTABILITY; TOMOSYNTHESIS; SIMULATION;
D O I
10.1088/1361-6560/acfadf
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective. This paper proposes a new objective function to improve the quality of synthesized breast CT images generated by the GAN and compares the GAN performances on transfer learning datasets from different image domains. Approach. The proposed objective function, named beta loss function, is based on the fact that x-ray-based breast images follow the power-law spectrum. Accordingly, the exponent of the power-law spectrum (beta value) for breast CT images is approximately two. The beta loss function is defined in terms of L1 distance between the beta value of synthetic images and validation samples. To compare the GAN performances for transfer learning datasets from different image domains, ImageNet and anatomical noise images are used in the transfer learning dataset. We employ styleGAN2 as the backbone network and add the proposed beta loss function. The patient-derived breast CT dataset is used as the training and validation dataset; 7355 and 212 images are used for network training and validation, respectively. We use the beta value evaluation and Frechet inception distance (FID) score for quantitative evaluation. Main results. For qualitative assessment, we attempt to replicate the images from the validation dataset using the trained GAN. Our results show that the proposed beta loss function achieves a more similar beta value to real images and a lower FID score. Moreover, we observe that the GAN pretrained with anatomical noise images achieves better equality than ImageNet for beta value evaluation and FID score. Finally, the beta loss function with anatomical noise as the transfer learning dataset achieves the lowest FID score. Significance. Overall, the GAN using the proposed beta loss function with anatomical noise images as the transfer learning dataset provides the lowest FID score among all tested cases. Hence, this work has implications for developing GAN-based breast image synthesis methods for medical imaging applications.
引用
收藏
页数:17
相关论文
共 70 条
[21]  
Denton E, 2015, ADV NEUR IN, V28
[22]   GEANT4 Monte Carlo simulations for virtual clinical trials in breast X-ray imaging: Proof of concept [J].
di Franco, F. ;
Sarno, A. ;
Mettivier, G. ;
Hernandez, A. M. ;
Bliznakova, K. ;
Boone, J. M. ;
Russo, P. .
PHYSICA MEDICA-EUROPEAN JOURNAL OF MEDICAL PHYSICS, 2020, 74 :133-142
[23]   Federated Learning of Generative Image Priors for MRI Reconstruction [J].
Elmas, Gokberk ;
Dar, Salman U. H. ;
Korkmaz, Yilmaz ;
Ceyani, Emir ;
Susam, Burak ;
Ozbey, Muzaffer ;
Avestimehr, Salman ;
Cukur, Tolga .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (07) :1996-2009
[24]  
Frid-Adar M, 2018, I S BIOMED IMAGING, P289, DOI 10.1109/ISBI.2018.8363576
[25]   Anatomical background and generalized detectability in tomosynthesis and cone-beam CT [J].
Gang, G. J. ;
Tward, D. J. ;
Lee, J. ;
Siewerdsen, J. H. .
MEDICAL PHYSICS, 2010, 37 (05) :1948-1965
[26]   Generative Adversarial Networks in Medical Image Processing [J].
Gong, Meiqin ;
Chen, Siyu ;
Chen, Qingyuan ;
Zeng, Yuanqi ;
Zhang, Yongqing .
CURRENT PHARMACEUTICAL DESIGN, 2021, 27 (15) :1856-1868
[27]  
Goodfellow I, 2017, Arxiv, DOI arXiv:1701.00160
[28]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144
[29]   A New, Open-Source, Multi-Modality Digital Breast Phantom [J].
Graff, Christian G. .
MEDICAL IMAGING 2016: PHYSICS OF MEDICAL IMAGING, 2016, 9783
[30]   Adaptive diffusion priors for accelerated MRI reconstruction [J].
Gungor, Alper ;
Dar, Salman U. H. ;
Ozturk, Saban ;
Korkmaz, Yilmaz ;
Bedel, Hasan A. ;
Elmas, Gokberk ;
Ozbey, Muzaffer ;
Cukur, Tolga .
MEDICAL IMAGE ANALYSIS, 2023, 88