Automatic detection of microaneurysms in optical coherence tomography images of retina using convolutional neural networks and transfer learning

被引:3
作者
Almasi, Ramin [1 ]
Vafaei, Abbas [1 ]
Kazeminasab, Elahe [1 ]
Rabbani, Hossein [2 ]
机构
[1] Univ Isfahan, Fac Engn, Dept Comp Engn, Esfahan, Iran
[2] Isfahan Univ Med Sci, Med Image & Signal Proc Res Ctr, Esfahan, Iran
关键词
FLUORESCEIN ANGIOGRAPHY; DIABETIC-RETINOPATHY;
D O I
10.1038/s41598-022-18206-8
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Microaneurysms (MAs) are pathognomonic signs that help clinicians to detect diabetic retinopathy (DR) in the early stages. Automatic detection of MA in retinal images is an active area of research due to its application in screening processes for DR which is one of the main reasons of blindness amongst the working-age population. The focus of these works is on the automatic detection of MAs in en face retinal images like fundus color and Fluorescein Angiography (FA). On the other hand, detection of MAs from Optical Coherence Tomography (OCT) images has 2 main advantages: first, OCT is a non-invasive imaging technique that does not require injection, therefore is safer. Secondly, because of the proven application of OCT in detection of Age-Related Macular Degeneration, Diabetic Macular Edema, and normal cases, thanks to detecting MAs in OCT, extensive information is obtained by using this imaging technique. In this research, the concentration is on the diagnosis of MAs using deep learning in the OCT images which represent in-depth structure of retinal layers. To this end, OCT B-scans should be divided into strips and MA patterns should be searched in the resulted strips. Since we need a dataset comprising OCT image strips with suitable labels and such large labelled datasets are not yet available, we have created it. For this purpose, an exact registration method is utilized to align OCT images with FA photographs. Then, with the help of corresponding FA images, OCT image strips are created from OCT B-scans in four labels, namely MA, normal, abnormal, and vessel. Once the dataset of image strips is prepared, a stacked generalization (stacking) ensemble of four fine-tuned, pre-trained convolutional neural networks is trained to classify the strips of OCT images into the mentioned classes. FA images are used once to create OCT strips for training process and they are no longer needed for subsequent steps. Once the stacking ensemble model is obtained, it will be used to classify the OCT strips in the test process. The results demonstrate that the proposed framework classifies overall OCT image strips and OCT strips containing MAs with accuracy scores of 0.982 and 0.987, respectively.
引用
收藏
页数:11
相关论文
共 39 条
  • [21] Pangyuteng, 2013, GRAPH BAS SEGM RET L
  • [22] Qin L., 3 INT C MULT TECHN, P1334
  • [23] Macular OCT Classification Using a Multi-Scale Convolutional Neural Network Ensemble
    Rasti, Reza
    Rabbani, Hossein
    Mehridehnavi, Alireza
    Hajizadeh, Fedra
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (04) : 1024 - 1034
  • [24] Sanchez C. I., MED IMAGING 2009 COM
  • [25] Shan J., 2016 IEEE 1 INT C CO, P357
  • [26] Deep Learning Classification on Optical Coherence Tomography Retina Images
    Shih, Frank Y.
    Patel, Himanshu
    [J]. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2020, 34 (08)
  • [27] Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556
  • [28] Sopharak Akara, 2011, IAENG International Journal of Computer Science, V38, P295
  • [29] Image-processing strategy for the segmentation and quantification of microaneurysms in fluorescein angiograms of the ocular fundus
    Spencer, T
    Olson, JA
    McHardy, KC
    Sharp, PF
    Forrester, JV
    [J]. COMPUTERS AND BIOMEDICAL RESEARCH, 1996, 29 (04): : 284 - 302
  • [30] Streeter L., 2003, IMAGE VISION COMPUT, P280