Fundus-DeepNet: Multi-label deep learning classification system for enhanced detection of multiple ocular diseases through data fusion of fundus images

被引:41
作者
Al-Fahdawi, Shumoos [1 ]
Al-Waisy, Alaa S. [2 ]
Zeebaree, Diyar Qader [3 ]
Qahwaji, Rami [4 ]
Natiq, Hayder [5 ]
Mohammed, Mazin Abed [6 ,7 ,8 ]
Nedoma, Jan [7 ]
Martinek, Radek [8 ]
Deveci, Muhammet [9 ,10 ,11 ]
机构
[1] Univ Fallujah, Elect Comp Ctr, Al Anbar, Iraq
[2] Univ Fallujah, Coll Appl Sci, Dept Med Phys, Al Anbar, Iraq
[3] Duhok Polytech Univ, Tech Coll Duhok, Informat Technol Dept, Duhok, Iraq
[4] Univ Bradford, Sch Elect Engn & Comp Sci, Bradford BD7 1DP, England
[5] Imam Jaafar Al Sadiq Univ, Coll Informat Technol, Dept Comp Technol Engn, Baghdad 10001, Iraq
[6] Univ Anbar, Coll Comp Sci & Informat Technol, Dept Artificial Intelligence, Ramadi 31001, Anbar, Iraq
[7] VSB Tech Univ Ostrava, Dept Telecommun, Ostrava, Czech Republic
[8] VSB Tech Univ Ostrava, Dept Cybernet & Biomed Engn, Ostrava, Czech Republic
[9] Natl Def Univ, Turkish Naval Acad, Dept Ind Engn, TR-34940 Istanbul, Turkiye
[10] UCL, Bartlett Sch Sustainable Construction, Gower St, London WC1E 6BT, England
[11] Lebanese Amer Univ, Dept Elect & Comp Engn, Byblos, Lebanon
关键词
Fundus images; Deep learning; Data fusion; Feature level fusion; OIA-ODIR dataset; High-Resolution network; FRAMEWORK;
D O I
10.1016/j.inffus.2023.102059
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Detecting multiple ocular diseases in fundus images is crucial in ophthalmic diagnosis. This study introduces the Fundus-DeepNet system, an automated multi-label deep learning classification system designed to identify multiple ocular diseases by integrating feature representations from pairs of fundus images (e.g., left and right eyes). The study initiates with a comprehensive image pre-processing procedure, including circular border cropping, image resizing, contrast enhancement, noise removal, and data augmentation. Subsequently, discriminative deep feature representations are extracted using multiple deep learning blocks, namely the HighResolution Network (HRNet) and Attention Block, which serve as feature descriptors. The SENet Block is then applied to further enhance the quality and robustness of feature representations from a pair of fundus images, ultimately consolidating them into a single feature representation. Finally, a sophisticated classification model, known as a Discriminative Restricted Boltzmann Machine (DRBM), is employed. By incorporating a Softmax layer, this DRBM is adept at generating a probability distribution that specifically identifies eight different ocular diseases. Extensive experiments were conducted on the challenging Ophthalmic Image Analysis-Ocular Disease Intelligent Recognition (OIA-ODIR) dataset, comprising diverse fundus images depicting eight different ocular diseases. The Fundus-DeepNet system demonstrated F1-scores, Kappa scores, AUC, and final scores of 88.56 %, 88.92 %, 99.76 %, and 92.41 % in the off-site test set, and 89.13 %, 88.98 %, 99.86 %, and 92.66 % in the on-site test set.In summary, the Fundus-DeepNet system exhibits outstanding proficiency in accurately detecting multiple ocular diseases, offering a promising solution for early diagnosis and treatment in ophthalmology.
引用
收藏
页数:11
相关论文
共 33 条
[1]  
Al-Waisy A.S., 2018, A multimodal biometric system for personal identification based on deep learning approaches
[2]   RETRACTED: COVID-CheXNet: hybrid deep learning framework for identifying COVID-19 virus in chest X-rays images (Retracted Article) [J].
Al-Waisy, Alaa S. ;
Al-Fahdawi, Shumoos ;
Mohammed, Mazin Abed ;
Abdulkareem, Karrar Hameed ;
Mostafa, Salama A. ;
Maashi, Mashael S. ;
Arif, Muhammad ;
Garcia-Zapirain, Begonya .
SOFT COMPUTING, 2023, 27 (05) :2657-2672
[3]   A multimodal deep learning framework using local feature representations for face recognition [J].
Al-Waisy, Alaa S. ;
Qahwaji, Rami ;
Ipson, Stanley ;
Al-Fahdawi, Shumoos .
MACHINE VISION AND APPLICATIONS, 2018, 29 (01) :35-54
[4]   Deep Learning Techniques for Diabetic Retinopathy Classification: A Survey [J].
Atwany, Mohammad Z. ;
Sahyoun, Abdulwahab H. ;
Yaqub, Mohammad .
IEEE ACCESS, 2022, 10 :28642-28655
[5]   Pointwise Convolutional Neural Networks [J].
Binh-Son Hua ;
Minh-Khoi Tran ;
Yeung, Sai-Kit .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :984-993
[6]  
Deng Xiangyu, 2022, Proceedings of SPIE, V12342, DOI 10.1117/12.2644254
[7]  
Ferris FL, 2005, ARCH OPHTHALMOL-CHIC, V123, P1570
[8]   Global causes of blindness and distance vision impairment 1990-2020: a systematic review and meta-analysis [J].
Flaxman, Seth R. ;
Bourne, Rupert R. A. ;
Resnikoff, Serge ;
Ackland, Peter ;
Braithwaite, Tasanee ;
Cicinelli, Maria V. ;
Das, Aditi ;
Jonas, Jost B. ;
Keeffe, Jill ;
Kempen, John H. ;
Leasher, Janet ;
Limburg, Hans ;
Naidoo, Kovin ;
Pesudovs, Konrad ;
Silvester, Alex ;
Stevens, Gretchen A. ;
Tahhan, Nina ;
Wong, Tien Y. ;
Taylor, Hugh R. .
LANCET GLOBAL HEALTH, 2017, 5 (12) :E1221-E1234
[9]   Multi-class multi-label ophthalmological disease detection using transfer learning based convolutional neural network [J].
Gour, Neha ;
Khanna, Pritee .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 66
[10]   Multi-label ocular disease classification with a dense correlation deep neural network [J].
He, Junjun ;
Li, Cheng ;
Ye, Jin ;
Qiao, Yu ;
Gu, Lixu .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2021, 63