A Structure-Consistency GAN for Unpaired AS-OCT Image Inpainting

被引:3
作者
Bai, Guanhua [1 ]
Li, Sanqian [2 ,3 ]
Zhang, He [1 ]
Higashita, Risa [1 ,2 ,3 ,4 ]
Liu, Jiang [1 ,2 ,3 ]
Li, Jie [1 ]
Zhang, Meng [1 ]
机构
[1] Changchun Univ, Changchun, Peoples R China
[2] Southern Univ Sci & Technol, Res Inst Trustworthy Autonomous Syst, Shenzhen, Peoples R China
[3] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Peoples R China
[4] Tomey Corp, Nagoya, Aichi, Japan
来源
OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2023 | 2023年 / 14096卷
关键词
AS-OCT; Inpainting; GAN; structural consistency; SEGMENTATION;
D O I
10.1007/978-3-031-44013-7_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior segment optical coherence tomography (AS-OCT) is a crucial imaging modality in ophthalmology, providing valuable insights into corneal pathologies. However, during AS-OCT imaging, intense signals in highly reflective regions can easily lead to saturation effects, resulting in pronounced stripes across the cornea. It compromises the image visual quality and impacts automated ophthalmic analysis. To address this issue, we propose an unsupervised Structure-Consistency Generative Adversarial Network (SC-GAN) that captures the underlying semantic structural knowledge in both the spatial domain and frequency space within the generative model. This strategy aims to mitigate the influence of bright stripes and restore corneal structural details in AS-OCT images. Specifically, SC-GAN introduces a stripe perceptual loss to extract visual representations by utilizing the perceptual similarity between striped and stripe-free images. Moreover, Fourier feature mapping is adopted to learn high-frequency information, thereby achieving crucial structure consistency. The experimental results demonstrate that the proposed SC-GAN can removes stripes while preserving crucial corneal structures, surpassing the competing algorithms. Furthermore, we validate the benefits of SC-GAN in the corneal segmentation task.
引用
收藏
页码:142 / 151
页数:10
相关论文
共 26 条
[1]   Attenuation of stripe artifacts in optical coherence tomography images through wavelet-FFT filtering [J].
Byers, Robert ;
Matcher, Stephen .
BIOMEDICAL OPTICS EXPRESS, 2019, 10 (08) :4179-4189
[2]   DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images [J].
Cheong, Haris ;
Devalla, Sripad Krishna ;
Tan Hung Pham ;
Zhang, Liang ;
Tin Aung Tun ;
Wang, Xiaofei ;
Perera, Shamira ;
Schmetterer, Leopold ;
Tin Aung ;
Boote, Craig ;
Thiery, Alexandre ;
Girard, Michael J. A. .
TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02) :1-15
[3]  
Fisher R., 1920, METRON, V1, P3
[4]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[5]  
HOLDEN BA, 1983, INVEST OPHTH VIS SCI, V24, P218
[6]   Real-time reference A-line subtraction and saturation artifact removal using graphics processing unit for high-frame-rate Fourier-domain optical coherence tomography video imaging [J].
Huang, Yong ;
Kang, Jin U. .
OPTICAL ENGINEERING, 2012, 51 (07)
[7]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[8]  
Kim J., 2020, INT C LEARN REPR, P1
[9]  
Kingma D. P., 2015, P 3 INT C LEARN REPR
[10]   Robust automatic segmentation of corneal layer boundaries in SDOCT images using graph theory and dynamic programming [J].
LaRocca, Francesco ;
Chiu, Stephanie J. ;
McNabb, Ryan P. ;
Kuo, Anthony N. ;
Izatt, Joseph A. ;
Farsiu, Sina .
BIOMEDICAL OPTICS EXPRESS, 2011, 2 (06) :1524-1538