OCT Image Synthesis through Deep Generative Models

被引:1
作者
Melo, Tania [1 ,2 ]
Cardoso, Jaime [1 ,2 ]
Carneiro, Angela [3 ,4 ]
Campilho, Aurelio [1 ,2 ]
Mendonca, Ana Maria [1 ,2 ]
机构
[1] Inst Engn Sistemas & Comp Tecnol & Ciencia, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
[2] Univ Porto, Fac Engn, Dept Engn Eletrotecn Comp, Rua Dr Roberto Frias, P-4200465 Porto, Portugal
[3] Univ Porto, Fac Med, Dept Cirurgia & Fisiol, Alameda Prof Hernani Monteiro, P-4200319 Porto, Portugal
[4] Ctr Hosp Univ Sao Joao, Alameda Prof Hernani Monteiro, P-4200319 Porto, Portugal
来源
2023 IEEE 36TH INTERNATIONAL SYMPOSIUM ON COMPUTER-BASED MEDICAL SYSTEMS, CBMS | 2023年
关键词
OCT image generation; normalizing flow models; generative adversarial networks;
D O I
10.1109/CBMS58004.2023.00279
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The development of accurate methods for OCT image analysis is highly dependent on the availability of large annotated datasets. As such datasets are usually expensive and hard to obtain, novel approaches based on deep generative models have been proposed for data augmentation. In this work, a flow-based network (SRFlow) and a generative adversarial network (ESRGAN) are used for synthesizing high-resolution OCT B-scans from low-resolution versions of real OCT images. The quality of the images generated by the two models is assessed using two standard fidelity-oriented metrics and a learned perceptual quality metric. The performance of two classification models trained on real and synthetic images is also evaluated. The obtained results show that the images generated by SRFlow preserve higher fidelity to the ground truth, while the outputs of ESRGAN present, on average, better perceptual quality. Independently of the architecture of the network chosen to classify the OCT B-scans, the model's performance always improves when images generated by SRFlow are included in the training set.
引用
收藏
页码:561 / 566
页数:6
相关论文
共 18 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis [J].
Cheplygina, Veronika ;
de Bruijne, Marleen ;
Pluim, Josien P. W. .
MEDICAL IMAGE ANALYSIS, 2019, 54 :280-296
[3]  
Kamran Sharif Amit, 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA), P964, DOI 10.1109/ICMLA.2019.00165
[4]   Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning [J].
Kermany, Daniel S. ;
Goldbaum, Michael ;
Cai, Wenjia ;
Valentim, Carolina C. S. ;
Liang, Huiying ;
Baxter, Sally L. ;
McKeown, Alex ;
Yang, Ge ;
Wu, Xiaokang ;
Yan, Fangbing ;
Dong, Justin ;
Prasadha, Made K. ;
Pei, Jacqueline ;
Ting, Magdalena ;
Zhu, Jie ;
Li, Christina ;
Hewett, Sierra ;
Dong, Jason ;
Ziyar, Ian ;
Shi, Alexander ;
Zhang, Runze ;
Zheng, Lianghong ;
Hou, Rui ;
Shi, William ;
Fu, Xin ;
Duan, Yaou ;
Huu, Viet A. N. ;
Wen, Cindy ;
Zhang, Edward D. ;
Zhang, Charlotte L. ;
Li, Oulan ;
Wang, Xiaobo ;
Singer, Michael A. ;
Sun, Xiaodong ;
Xu, Jie ;
Tafreshi, Ali ;
Lewis, M. Anthony ;
Xia, Huimin ;
Zhang, Kang .
CELL, 2018, 172 (05) :1122-+
[5]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[6]   SRFlow: Learning the Super-Resolution Space with Normalizing Flow [J].
Lugmayr, Andreas ;
Danelljan, Martin ;
Van Gool, Luc ;
Timofte, Radu .
COMPUTER VISION - ECCV 2020, PT V, 2020, 12350 :715-732
[7]   Multi-Level Dual-Attention Based CNN for Macular Optical Coherence Tomography Classification [J].
Mishra, Sapna S. ;
Mandal, Bappaditya ;
Puhan, N. B. .
IEEE SIGNAL PROCESSING LETTERS, 2019, 26 (12) :1793-1797
[8]  
Shen DG, 2017, ANNU REV BIOMED ENG, V19, P221, DOI [10.1146/annurev-bioeng-071516-044442, 10.1146/annurev-bioeng-071516044442]
[9]  
Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
[10]   MedAL: Accurate and Robust Deep Active Learning for Medical Image Analysis [J].
Smailagic, Asim ;
Costa, Pedro ;
Noh, Hae Young ;
Walawalkar, Devesh ;
Khandelwal, Kartik ;
Galdran, Adrian ;
Mirshekari, Mostafa ;
Fagert, Jonathon ;
Xu, Susu ;
Zhang, Pei ;
Campilho, Aurelio .
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, :481-488