High/Low Quality Style Transfer for Mutual Conversion of OCT Images Using Contrastive Unpaired Translation Generative Adversarial Networks

被引:3
作者
Gende, Mateo [1 ,2 ]
de Moura, Joaquim [1 ,2 ]
Novo, Jorge [1 ,2 ]
Ortega, Marcos [1 ,2 ]
机构
[1] Univ A Coruna, Ctr Invest, La Coruna, Spain
[2] Univ A Coruna, Inst Invest Biomed A Coruna INIBIC, Grp VARPA, La Coruna, Spain
来源
IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I | 2022年 / 13231卷
关键词
Optical coherence tomography; Generative adversarial networks; Style transfer; Synthetic images; DIABETIC-RETINOPATHY; DEEP; SEGMENTATION; VALIDATION; DISEASES;
D O I
10.1007/978-3-031-06427-2_18
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in artificial intelligence and deep learning models are contributing to the development of advanced computer-aided diagnosis (CAD) systems. In the context of medical imaging, Optical Coherence Tomography (OCT) is a valuable technique that is able to provide cross-sectional visualisations of the ocular tissue. However, OCT is constrained by a limitation between the quality of the visualisations that it can produce and the overall amount of tissue that can be analysed at once. This limitation leads to a scarcity of high quality data, a problem that is very prevalent when developing machine learning-based CAD systems intended for medical imaging. To mitigate this problem, we present a novel methodology for the unpaired conversion of OCT images acquired with a low quality extensive scanning preset into the visual style of those taken with a high quality intensive scan and vice versa. This is achieved by employing contrastive unpaired translation generative adversarial networks to convert between the visual styles of the different acquisition presets. The results we obtained in the validation experiments show that these synthetic generated images can mirror the visual features of the original ones while preserving the natural tissue texture, effectively increasing the total number of available samples that can be used to train robust machine learning-based CAD systems.
引用
收藏
页码:210 / 220
页数:11
相关论文
共 28 条
  • [1] Automatically Enhanced OCT Scans of the Retina: A proof of concept study
    Apostolopoulos, Stefanos
    Salas, Jazmin
    Ordonez, Jose L. P.
    Tan, Shern Shiou
    Ciller, Carlos
    Ebneter, Andreas
    Zinkernagel, Martin
    Sznitman, Raphael
    Wolf, Sebastian
    De Zanet, Sandro
    Munk, Marion R.
    [J]. SCIENTIFIC REPORTS, 2020, 10 (01)
  • [2] Chaabouni A, 2014, INT CONF IMAG PROC, P18
  • [3] Artificial Intelligence in Diabetic Eye Disease Screening
    Cheung, Carol Y.
    Tang, Fangyao
    Ting, Daniel Shu Wei
    Tan, Gavin Siew Wei
    Wong, Tien Yin
    [J]. ASIA-PACIFIC JOURNAL OF OPHTHALMOLOGY, 2019, 8 (02): : 158 - 164
  • [4] deMoura J., 2019, 2019 INT JOINT C NEU, DOI [10.1109/ijcnn.2019.8852196, DOI 10.1109/IJCNN.2019.8852196]
  • [5] Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation
    Fu, Huazhu
    Cheng, Jun
    Xu, Yanwu
    Wong, Damon Wing Kee
    Liu, Jiang
    Cao, Xiaochun
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (07) : 1597 - 1605
  • [6] Automatic Segmentation and Intuitive Visualisation of the Epiretinal Membrane in 3D OCT Images Using Deep Convolutional Approaches
    Gende, Mateo
    De Moura, Joaquim
    Novo, Jorge
    Charlon, Pablo
    Ortega, Marcos
    [J]. IEEE ACCESS, 2021, 9 (09): : 75993 - 76004
  • [7] Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs
    Gulshan, Varun
    Peng, Lily
    Coram, Marc
    Stumpe, Martin C.
    Wu, Derek
    Narayanaswamy, Arunachalam
    Venugopalan, Subhashini
    Widner, Kasumi
    Madams, Tom
    Cuadros, Jorge
    Kim, Ramasamy
    Raman, Rajiv
    Nelson, Philip C.
    Mega, Jessica L.
    Webster, R.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22): : 2402 - 2410
  • [8] Densely Connected Convolutional Networks
    Huang, Gao
    Liu, Zhuang
    van der Maaten, Laurens
    Weinberger, Kilian Q.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 2261 - 2269
  • [9] Simultaneous denoising and super-resolution of optical coherence tomography images based on a generative adversarial network
    Huang, Yongqiang
    Lu, Zexin
    Shao, Zhimin
    Ran, Maosong
    Zhou, Jiliu
    Fang, Leyuan
    Zhang, Yi
    [J]. OPTICS EXPRESS, 2019, 27 (09): : 12289 - 12307
  • [10] Macular Optical Coherence Tomography Imaging in Glaucoma
    Kamalipour, Alireza
    Moghimi, Sasan
    [J]. JOURNAL OF OPHTHALMIC & VISION RESEARCH, 2021, 16 (03) : 478 - 489