Generating Synthetic Images for Healthcare with Novel Deep Pix2Pix GAN

被引:24
作者
Aljohani, Abeer [1 ]
Alharbe, Nawaf [1 ]
机构
[1] Taibah Univ, Appl Coll, Comp Sci Dept, Madinah 46537, Saudi Arabia
关键词
GAN; Cyc1eGAN; Pix2Pix GAN; medical images; image synthesis; image transmission;
D O I
10.3390/electronics11213470
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Due to recent developments in deep learning and artificial intelligence, the healthcare industry is currently going through a significant upheaval. Despite a considerable advance in medical imaging and diagnostics, the healthcare industry still has a lot of unresolved problems and unexplored applications. The transmission of a huge number of medical images in particular is a difficult and time-consuming problem. In addition, obtaining new medical images is too expensive. To tackle these issues, we propose deep pix2pix generative adversarial networks (GAN) for generating synthetic medical images. For the comparison, we implemented CycleGAN, Pix2Pix GAN and Deep Pix2Pix GAN. The result has shown that our proposed approach can generate a new synthetic medical image from a different image with more accuracy than that of the other models. To provide a robust model, we trained and evaluated our models on a widely used brain image dataset, the IXI Dataset.
引用
收藏
页数:8
相关论文
共 27 条
[1]   Generating Highly Realistic Images of Skin Lesions with GANs [J].
Baur, Christoph ;
Albarqouni, Shadi ;
Navab, Nassir .
OR 2.0 CONTEXT-AWARE OPERATING THEATERS, COMPUTER ASSISTED ROBOTIC ENDOSCOPY, CLINICAL IMAGE-BASED PROCEDURES, AND SKIN IMAGE ANALYSIS, OR 2.0 2018, 2018, 11041 :260-267
[2]  
Ben-Cohen Avi, 2017, Simulation and Synthesis in Medical Imaging. Second International Workshop, SASHIMI 2017. Held in Conjunction with MICCAI 2017. Proceedings: LNCS 10557, P49, DOI 10.1007/978-3-319-68127-6_6
[3]   Synthesis of Multispectral Optical Images From SAR/Optical Multitemporal Data Using Conditional Generative Adversarial Networks [J].
Bermudez, Jose D. ;
Happ, Patrick N. ;
Feitosa, Raul Q. ;
Oliveira, Dario A. B. .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (08) :1220-1224
[4]  
brain-development.org, Ixi dataset
[5]  
Chuquicusma MJM, 2018, I S BIOMED IMAGING, P240, DOI 10.1109/ISBI.2018.8363564
[6]  
Costa P., 2017, ARXIV
[7]   SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays [J].
Dai, Wei ;
Dong, Nanqing ;
Wang, Zeya ;
Liang, Xiaodan ;
Zhang, Hao ;
Xing, Eric P. .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, DLMIA 2018, 2018, 11045 :263-273
[8]   GAN-based synthetic medical image augmentation for increased CNN performance in liver lesion classification [J].
Frid-Adar, Maayan ;
Diamant, Idit ;
Klang, Eyal ;
Amitai, Michal ;
Goldberger, Jacob ;
Greenspan, Hayit .
NEUROCOMPUTING, 2018, 321 :321-331
[9]  
Goodfellow I., 2014, P 2014 ADV NEURAL IN
[10]   Generating Diffusion MRI Scalar Maps from T1 Weighted Images Using Generative Adversarial Networks [J].
Gu, Xuan ;
Knutsson, Hans ;
Nilsson, Markus ;
Eklund, Anders .
IMAGE ANALYSIS, 2019, 11482 :489-498