Retinal Disease Diagnosis Using Deep Learning on Ultra-Wide-Field Fundus Images

被引:5
作者
Nguyen, Toan Duc [1 ]
Le, Duc-Tai [2 ]
Bum, Junghyun [3 ]
Kim, Seongho [4 ]
Song, Su Jeong [4 ,5 ]
Choo, Hyunseung [1 ,2 ,6 ]
机构
[1] Sungkyunkwan Univ, Dept AI Syst Engn, Suwon 16419, South Korea
[2] Sungkyunkwan Univ, Coll Comp & Informat, Suwon 16419, South Korea
[3] Sungkyunkwan Univ, Sungkyun AI Res Inst, Suwon 16419, South Korea
[4] Sungkyunkwan Univ, Kangbuk Samsung Hosp, Sch Med, Dept Ophthalmol, Suwon 16419, South Korea
[5] Sungkyunkwan Univ, Biomed Inst Convergence, Suwon 16419, South Korea
[6] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon 16419, South Korea
关键词
medical image processing; deep learning; fundus image; convolutional neural network; vision transformer;
D O I
10.3390/diagnostics14010105
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Ultra-wide-field fundus imaging (UFI) provides comprehensive visualization of crucial eye components, including the optic disk, fovea, and macula. This in-depth view facilitates doctors in accurately diagnosing diseases and recommending suitable treatments. This study investigated the application of various deep learning models for detecting eye diseases using UFI. We developed an automated system that processes and enhances a dataset of 4697 images. Our approach involves brightness and contrast enhancement, followed by applying feature extraction, data augmentation and image classification, integrated with convolutional neural networks. These networks utilize layer-wise feature extraction and transfer learning from pre-trained models to accurately represent and analyze medical images. Among the five evaluated models, including ResNet152, Vision Transformer, InceptionResNetV2, RegNet and ConVNext, ResNet152 is the most effective, achieving a testing area under the curve (AUC) score of 96.47% (with a 95% confidence interval (CI) of 0.931-0.974). Additionally, the paper presents visualizations of the model's predictions, including confidence scores and heatmaps that highlight the model's focal points-particularly where lesions due to damage are evident. By streamlining the diagnosis process and providing intricate prediction details without human intervention, our system serves as a pivotal tool for ophthalmologists. This research underscores the compatibility and potential of utilizing ultra-wide-field images in conjunction with deep learning.
引用
收藏
页数:19
相关论文
共 32 条
  • [1] Cai Z., 2022, arXiv
  • [2] Chen T., 2020, P 37 INT C MACHINE, P1597
  • [3] Multi-categorical deep learning neural network to classify retinal images: A pilot study employing small database
    Choi, Joon Yul
    Yoo, Tae Keun
    Seo, Jeong Gi
    Kwak, Jiyong
    Um, Terry Taewoong
    Rim, Tyler Hyungtaek
    [J]. PLOS ONE, 2017, 12 (11):
  • [4] Clinically applicable deep learning for diagnosis and referral in retinal disease
    De Fauw, Jeffrey
    Ledsam, Joseph R.
    Romera-Paredes, Bernardino
    Nikolov, Stanislav
    Tomasev, Nenad
    Blackwell, Sam
    Askham, Harry
    Glorot, Xavier
    O'Donoghue, Brendan
    Visentin, Daniel
    van den Driessche, George
    Lakshminarayanan, Balaji
    Meyer, Clemens
    Mackinder, Faith
    Bouton, Simon
    Ayoub, Kareem
    Chopra, Reena
    King, Dominic
    Karthikesalingam, Alan
    Hughes, Cian O.
    Raine, Rosalind
    Hughes, Julian
    Sim, Dawn A.
    Egan, Catherine
    Tufail, Adnan
    Montgomery, Hugh
    Hassabis, Demis
    Rees, Geraint
    Back, Trevor
    Khaw, Peng T.
    Suleyman, Mustafa
    Cornebise, Julien
    Keane, Pearse A.
    Ronneberger, Olaf
    [J]. NATURE MEDICINE, 2018, 24 (09) : 1342 - +
  • [5] Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
  • [6] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [7] Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs
    Gulshan, Varun
    Peng, Lily
    Coram, Marc
    Stumpe, Martin C.
    Wu, Derek
    Narayanaswamy, Arunachalam
    Venugopalan, Subhashini
    Widner, Kasumi
    Madams, Tom
    Cuadros, Jorge
    Kim, Ramasamy
    Raman, Rajiv
    Nelson, Philip C.
    Mega, Jessica L.
    Webster, R.
    [J]. JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2016, 316 (22): : 2402 - 2410
  • [8] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [9] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90
  • [10] Development of Decision Support Software for Deep Learning-Based Automated Retinal Disease Screening Using Relatively Limited Fundus Photograph Data
    Lee, JoonHo
    Lee, Joonseok
    Cho, Sooah
    Song, JiEun
    Lee, Minyoung
    Kim, Sung Ho
    Lee, Jin Young
    Shin, Dae Hwan
    Kim, Joon Mo
    Bae, Jung Hun
    Song, Su Jeong
    Sagong, Min
    Park, Donggeun
    [J]. ELECTRONICS, 2021, 10 (02) : 1 - 15