MediDRNet: Tackling category imbalance in diabetic retinopathy classification with dual-branch learning and prototypical contrastive learning

被引:1
作者
Teng, Siying [1 ]
Wang, Bo [2 ]
Yang, Feiyang [3 ]
Yi, Xingcheng [4 ]
Zhang, Xinmin [5 ]
Sun, Yabin [1 ]
机构
[1] First Hosp Jilin Univ, Dept Ophthalmol, Changchun 130021, Jilin, Peoples R China
[2] Univ Minho, P-4710057 Braga, Braga District, Portugal
[3] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Jilin, Peoples R China
[4] First Hosp Jilin Univ, Lab Canc Precis Med, Changchun 130013, Jilin, Peoples R China
[5] Jilin Univ, Sch Pharmaceut Sci, Dept Regenerat Med, Changchun 130021, Jilin, Peoples R China
关键词
Diabetic retinopathy; Imbalanced medical image classification; Prototypical supervised contrastive learning; Dual-branch network; Convolutional block attention module;
D O I
10.1016/j.cmpb.2024.108230
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: The classification of diabetic retinopathy (DR) aims to utilize the implicit information in images for early diagnosis, to prevent and mitigate the further worsening of the condition. However, existing methods are often limited by the need to operate within large, annotated datasets to show significant advantages. Additionally, the number of samples for different categories within the dataset needs to be evenly distributed, because the characteristic of sample imbalance distribution can lead to an excessive focus on high -frequency disease categories, while neglecting the less common but equally important disease categories. Therefore, there is an urgent need to develop a new classification method that can effectively alleviate the issue of sample distribution imbalance, thereby enhancing the accuracy of diabetic retinopathy classification. Methods: In this work, we propose MediDRNet, a dual -branch network model based on prototypical contrastive learning. This model adopts prototype contrastive learning, creating prototypes for different levels of lesions, ensuring they represent the core features of each lesion level. It classifies by comparing the similarity between data points and their category prototypes. Our dual -branch network structure effectively resolves the issue of category imbalance and improves classification accuracy by emphasizing subtle differences in retinal lesions. Moreover, our approach combines a dual -branch network with specific lesion -level prototypes for core feature representation and incorporates the convolutional block attention module for enhanced lesion feature identification. Results: Our experiments using both the Kaggle and UWF classification datasets have demonstrated that MediDRNet exhibits exceptional performance compared to other advanced models in the industry, especially on the UWF DR classification dataset where it achieved state-of-the-art performance across all metrics. On the Kaggle DR classification dataset, it achieved the highest average classification accuracy (0.6327) and Macro -F1 score (0.6361). Particularly in the classification tasks for minority categories of diabetic retinopathy on the Kaggle dataset (Grades 1, 2, 3, and 4), the model reached high classification accuracies of 58.08%, 55.32%, 69.73%, and 90.21%, respectively. In the ablation study, the MediDRNet model proved to be more effective in feature extraction from diabetic retinal fundus images compared to other feature extraction methods. Conclusions: This study employed prototype contrastive learning and bidirectional branch learning strategies, successfully constructing a grading system for diabetic retinopathy lesions within imbalanced diabetic retinopathy datasets. Through a dual -branch network, the feature learning branch effectively facilitated a smooth transition of features from the grading network to the classification learning branch, accurately identifying minority sample categories. This method not only effectively resolved the issue of sample imbalance but also provided strong support for the precise grading and early diagnosis of diabetic retinopathy in clinical applications, showcasing exceptional performance in handling complex diabetic retinopathy datasets. Moreover, this research significantly improved the efficiency of prevention and management of disease
引用
收藏
页数:10
相关论文
共 50 条
[21]   Deep Learning Techniques for Diabetic Retinopathy Classification: A Survey [J].
Atwany, Mohammad Z. ;
Sahyoun, Abdulwahab H. ;
Yaqub, Mohammad .
IEEE ACCESS, 2022, 10 :28642-28655
[22]   A Mobile Deep Learning Classification Model for Diabetic Retinopathy [J].
Rimaru, Daniel ;
Nehme, Antonio ;
Alhussein, Musaed ;
Mahbub, Khaled ;
Aurangzeb, Khusheed ;
Khan, Anas .
ELEKTRONIKA IR ELEKTROTECHNIKA, 2024, 30 (06) :45-52
[23]   Detection and classification of diabetic retinopathy based on ensemble learning [J].
Ankur Biswas ;
Rita Banik .
Advances in Computational Intelligence, 2024, 4 (3)
[24]   Enhancing diabetic retinopathy classification using deep learning [J].
Alwakid, Ghadah ;
Gouda, Walaa ;
Humayun, Mamoona ;
Jhanjhi, N. Z. .
DIGITAL HEALTH, 2023, 9
[25]   Deep Learning-Based Classification of Diabetic Retinopathy [J].
Huang, Zhenjia .
PROCEEDINGS OF 2023 4TH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE FOR MEDICINE SCIENCE, ISAIMS 2023, 2023, :371-375
[26]   Enhancing diabetic retinopathy classification accuracy through dual-attention mechanism in deep learning [J].
Hannan, Abdul ;
Mahmood, Zahid ;
Qureshi, Rizwan ;
Ali, Hazrat .
COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, 2025, 13 (01)
[27]   Using Deep Learning Architectures for Detection and Classification of Diabetic Retinopathy [J].
Mohanty, Cheena ;
Mahapatra, Sakuntala ;
Acharya, Biswaranjan ;
Kokkoras, Fotis ;
Gerogiannis, Vassilis C. ;
Karamitsos, Ioannis ;
Kanavos, Andreas .
SENSORS, 2023, 23 (12)
[28]   Improving the Accuracy of Diabetic Retinopathy Severity Classification with Transfer Learning [J].
Thota, Narayana Bhagirath ;
Reddy, Doshna Umma .
2020 IEEE 63RD INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2020, :1003-1006
[29]   An active learning method for diabetic retinopathy classification with uncertainty quantification [J].
Ahsan, Muhammad Ahtazaz ;
Qayyum, Adnan ;
Razi, Adeel ;
Qadir, Junaid .
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING, 2022, 60 (10) :2797-2811
[30]   Deep Learning Framework Design for Diabetic Retinopathy Abnormalities Classification [J].
Sood, Meenakshi ;
Jain, Shruti ;
Bhardwaj, Charu .
4TH INTERDISCIPLINARY CONFERENCE ON ELECTRICS AND COMPUTER, INTCEC 2024, 2024,