A Structure-Consistency GAN for Unpaired AS-OCT Image Inpainting

被引:2
作者
Bai, Guanhua [1 ]
Li, Sanqian [2 ,3 ]
Zhang, He [1 ]
Higashita, Risa [1 ,2 ,3 ,4 ]
Liu, Jiang [1 ,2 ,3 ]
Li, Jie [1 ]
Zhang, Meng [1 ]
机构
[1] Changchun Univ, Changchun, Peoples R China
[2] Southern Univ Sci & Technol, Res Inst Trustworthy Autonomous Syst, Shenzhen, Peoples R China
[3] Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Peoples R China
[4] Tomey Corp, Nagoya, Aichi, Japan
来源
OPHTHALMIC MEDICAL IMAGE ANALYSIS, OMIA 2023 | 2023年 / 14096卷
关键词
AS-OCT; Inpainting; GAN; structural consistency; SEGMENTATION;
D O I
10.1007/978-3-031-44013-7_15
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anterior segment optical coherence tomography (AS-OCT) is a crucial imaging modality in ophthalmology, providing valuable insights into corneal pathologies. However, during AS-OCT imaging, intense signals in highly reflective regions can easily lead to saturation effects, resulting in pronounced stripes across the cornea. It compromises the image visual quality and impacts automated ophthalmic analysis. To address this issue, we propose an unsupervised Structure-Consistency Generative Adversarial Network (SC-GAN) that captures the underlying semantic structural knowledge in both the spatial domain and frequency space within the generative model. This strategy aims to mitigate the influence of bright stripes and restore corneal structural details in AS-OCT images. Specifically, SC-GAN introduces a stripe perceptual loss to extract visual representations by utilizing the perceptual similarity between striped and stripe-free images. Moreover, Fourier feature mapping is adopted to learn high-frequency information, thereby achieving crucial structure consistency. The experimental results demonstrate that the proposed SC-GAN can removes stripes while preserving crucial corneal structures, surpassing the competing algorithms. Furthermore, we validate the benefits of SC-GAN in the corneal segmentation task.
引用
收藏
页码:142 / 151
页数:10
相关论文
共 26 条
  • [1] Attenuation of stripe artifacts in optical coherence tomography images through wavelet-FFT filtering
    Byers, Robert
    Matcher, Stephen
    [J]. BIOMEDICAL OPTICS EXPRESS, 2019, 10 (08): : 4179 - 4189
  • [2] DeshadowGAN: A Deep Learning Approach to Remove Shadows from Optical Coherence Tomography Images
    Cheong, Haris
    Devalla, Sripad Krishna
    Tan Hung Pham
    Zhang, Liang
    Tin Aung Tun
    Wang, Xiaofei
    Perera, Shamira
    Schmetterer, Leopold
    Tin Aung
    Boote, Craig
    Thiery, Alexandre
    Girard, Michael J. A.
    [J]. TRANSLATIONAL VISION SCIENCE & TECHNOLOGY, 2020, 9 (02): : 1 - 15
  • [3] Fisher R., 1920, Metron, V1, P3
  • [4] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [5] HOLDEN BA, 1983, INVEST OPHTH VIS SCI, V24, P218
  • [6] Real-time reference A-line subtraction and saturation artifact removal using graphics processing unit for high-frame-rate Fourier-domain optical coherence tomography video imaging
    Huang, Yong
    Kang, Jin U.
    [J]. OPTICAL ENGINEERING, 2012, 51 (07)
  • [7] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [8] Kim J., 2020, P INT C LEARN REPR
  • [9] Kingma D. P., 2015, INT C LEARN REPR
  • [10] Robust automatic segmentation of corneal layer boundaries in SDOCT images using graph theory and dynamic programming
    LaRocca, Francesco
    Chiu, Stephanie J.
    McNabb, Ryan P.
    Kuo, Anthony N.
    Izatt, Joseph A.
    Farsiu, Sina
    [J]. BIOMEDICAL OPTICS EXPRESS, 2011, 2 (06): : 1524 - 1538