Improved CycleGAN with application to COVID-19 classification

被引:8
作者
Bar-El, Asaf [1 ]
Cohen, Dana [1 ]
Cahan, Noa [1 ]
Greenspan, Hayit [1 ]
机构
[1] Tel Aviv Univ, Fac Engn, Tel Aviv, Israel
来源
MEDICAL IMAGING 2021: IMAGE PROCESSING | 2021年 / 11596卷
关键词
COVID-19; Classification; Synthetic Data Augmentation; Generative Networks; CycleGAN; Grad-CAM;
D O I
10.1117/12.2582162
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
One of the major problems in medical imaging is the shortage of pathology data. In most cases, the acquisition of labeled data is expensive and usually involves manual labeling by a skilled medical expert. Because of this, most medical imaging tasks suffer from a severe class imbalance with a bias towards non-pathological classes, resulting in reduced performance. The recent growth in the use of generative adversarial networks and their ability to generate synthetic data shows great promise for reducing the class imbalance problem. In this work we introduce the GC-CycleGAN model, a general method for CycleGAN factorization, utilizing Grad-CAMs as auxiliary data in the CycleGAN model to generate synthetic images. Our novel approach utilizes Grad-CAMs ability to describe class activation and uses it for improved network classification, rather than as a visualization tool. The spread of the COVID-19 pandemic is affecting the lives of millions worldwide. If proven effective, automated COVID-19 detection from chest X-ray images can be a supportive step in the fight against COVID-19. However, the task of COVID-19 classification suffers greatly from the class imbalance problem. Using the GC-CycleGAN method, we demonstrate in this work the ability to balance a heavily imbalanced dataset for the task of COVID-19 vs. non-COVID-19 pneumonia X-ray classification. We show improved results over two baselines and the COVID-Net model.
引用
收藏
页数:10
相关论文
共 16 条
[1]   Correlation of Chest CT and RT-PCR Testing for Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases [J].
Ai, Tao ;
Yang, Zhenlu ;
Hou, Hongyan ;
Zhan, Chenao ;
Chen, Chong ;
Lv, Wenzhi ;
Tao, Qian ;
Sun, Ziyong ;
Xia, Liming .
RADIOLOGY, 2020, 296 (02) :E32-E40
[2]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[3]  
Chu Casey, 2017, arXiv preprint arXiv:1712.02950
[4]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[6]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[7]  
Kingma DP, 2015, P 3 INT C LEARN REPR, P1, DOI DOI 10.1145/1830483.1830503
[8]  
Lin M., 2014, ICLR 2014 C SUBM
[9]   Focal Loss for Dense Object Detection [J].
Lin, Tsung-Yi ;
Goyal, Priya ;
Girshick, Ross ;
He, Kaiming ;
Dollar, Piotr .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (02) :318-327
[10]   Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review [J].
Ng, Ming-Yen ;
Lee, Elaine Y. P. ;
Yang, Jin ;
Yang, Fangfang ;
Li, Xia ;
Wang, Hongxia ;
Lui, Macy Mei-Sze ;
Lo, Christine Shing-Yen ;
Leung, Barry ;
Khong, Pek-Lan ;
Hui, Christopher Kim-Ming ;
Yuen, Kwok-Yung ;
Kuo, Michael D. .
RADIOLOGY-CARDIOTHORACIC IMAGING, 2020, 2 (01)