Multiple-ResNet GAN: An enhanced high-resolution image generation method for translation from fundus structure image to fluorescein angiography

被引:0
作者
Yuan, Jiahui [1 ]
Gao, Weiwei [1 ]
Fang, Yu [1 ]
Zhang, Haifeng [1 ]
Song, Nan [2 ]
机构
[1] Shanghai Univ Engn Sci, Inst Mech & Automot Engn, Shanghai 201620, Peoples R China
[2] Fudan Univ, Dept Ophthalmol, Eye & ENT Hosp, Shanghai 200031, Peoples R China
基金
中国国家自然科学基金;
关键词
Fundus structure images; Fluorescein angiography; High-resolution; Generative adversarial network (GAN); Multiple-ResNet;
D O I
10.1007/s11517-024-03191-z
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Fluorescein angiography (FA) is a diagnostic method for observing the vascular circulation in the eye. However, it poses a risk to patients. Therefore, generative adversarial networks have been used to convert retinal fundus structure images into FA images. Existing high-resolution image generation methods employ complex deep network models that are challenging to optimize, which leads to issues such as blurred lesion boundaries and poor capture of microleakage and microvessels. In this study, we propose a multiple-ResNet generative adversarial network (GAN) to improve model training, thereby enhancing the ability to generate high-resolution FA images. First, the structure of the multiple-ResNet generator is designed to enhance detail generation in high-resolution images. Second, the Gaussian error linear unit (GELU) activation function is used to help the model converge rapidly. The effectiveness of the multiple-ResNet is verified using the publicly available Isfahan MISP dataset. Experimental results show that our method outperforms other methods, achieving better quantitative results with a mean structural similarity of 0.641, peak signal-to-noise ratio of 18.25, and learned perceptual image patch similarity of 0.272. Compared with state-of-the-art methods, the results showed that using the multiple-ResNet framework and GELU activation function can improve the generation of detailed regions in high-resolution FA images.
引用
收藏
页码:181 / 194
页数:14
相关论文
共 29 条
  • [1] Abramoff Michael D, 2010, IEEE Rev Biomed Eng, V3, P169, DOI 10.1109/RBME.2010.2084567
  • [2] Diabetic Retinopathy Grading by Digital Curvelet Transform
    Alipour, Shirin Hajeb Mohammad
    Rabbani, Hossein
    Akhlaghi, Mohammad Reza
    [J]. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE, 2012, 2012
  • [3] Generative Adversarial Networks in Medical Image augmentation: A review
    Chen, Yizhou
    Yang, Xu-Hua
    Wei, Zihan
    Heidari, Ali Asghar
    Zheng, Nenggan
    Li, Zhicheng
    Chen, Huiling
    Hu, Haigen
    Zhou, Qianwei
    Guan, Qiu
    [J]. COMPUTERS IN BIOLOGY AND MEDICINE, 2022, 144
  • [4] Generative Adversarial Networks An overview
    Creswell, Antonia
    White, Tom
    Dumoulin, Vincent
    Arulkumaran, Kai
    Sengupta, Biswa
    Bharath, Anil A.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) : 53 - 65
  • [5] Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
  • [6] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [7] Hendrycks Dan, 2016, CoRR abs/1606.08415
  • [8] Deep Multimodal Reconstruction of Retinal Images Using Paired or Unpaired Data
    Hervella, Alvaro S.
    Rouco, Jose
    Novo, Jorge
    Ortega, Marcos
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [9] Hore Alain, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2366, DOI 10.1109/ICPR.2010.579
  • [10] Lesion-aware generative adversarial networks for color fundus image to fundus fluorescein angiography translation
    Huang, Kun
    Li, Mingchao
    Yu, Jiale
    Miao, Jinxin
    Hu, Zizhong
    Yuan, Songtao
    Chen, Qiang
    [J]. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2023, 229