MediDRNet: Tackling category imbalance in diabetic retinopathy classification with dual-branch learning and prototypical contrastive learning

被引:1
作者
Teng, Siying [1 ]
Wang, Bo [2 ]
Yang, Feiyang [3 ]
Yi, Xingcheng [4 ]
Zhang, Xinmin [5 ]
Sun, Yabin [1 ]
机构
[1] First Hosp Jilin Univ, Dept Ophthalmol, Changchun 130021, Jilin, Peoples R China
[2] Univ Minho, P-4710057 Braga, Braga District, Portugal
[3] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Jilin, Peoples R China
[4] First Hosp Jilin Univ, Lab Canc Precis Med, Changchun 130013, Jilin, Peoples R China
[5] Jilin Univ, Sch Pharmaceut Sci, Dept Regenerat Med, Changchun 130021, Jilin, Peoples R China
关键词
Diabetic retinopathy; Imbalanced medical image classification; Prototypical supervised contrastive learning; Dual-branch network; Convolutional block attention module;
D O I
10.1016/j.cmpb.2024.108230
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: The classification of diabetic retinopathy (DR) aims to utilize the implicit information in images for early diagnosis, to prevent and mitigate the further worsening of the condition. However, existing methods are often limited by the need to operate within large, annotated datasets to show significant advantages. Additionally, the number of samples for different categories within the dataset needs to be evenly distributed, because the characteristic of sample imbalance distribution can lead to an excessive focus on high -frequency disease categories, while neglecting the less common but equally important disease categories. Therefore, there is an urgent need to develop a new classification method that can effectively alleviate the issue of sample distribution imbalance, thereby enhancing the accuracy of diabetic retinopathy classification. Methods: In this work, we propose MediDRNet, a dual -branch network model based on prototypical contrastive learning. This model adopts prototype contrastive learning, creating prototypes for different levels of lesions, ensuring they represent the core features of each lesion level. It classifies by comparing the similarity between data points and their category prototypes. Our dual -branch network structure effectively resolves the issue of category imbalance and improves classification accuracy by emphasizing subtle differences in retinal lesions. Moreover, our approach combines a dual -branch network with specific lesion -level prototypes for core feature representation and incorporates the convolutional block attention module for enhanced lesion feature identification. Results: Our experiments using both the Kaggle and UWF classification datasets have demonstrated that MediDRNet exhibits exceptional performance compared to other advanced models in the industry, especially on the UWF DR classification dataset where it achieved state-of-the-art performance across all metrics. On the Kaggle DR classification dataset, it achieved the highest average classification accuracy (0.6327) and Macro -F1 score (0.6361). Particularly in the classification tasks for minority categories of diabetic retinopathy on the Kaggle dataset (Grades 1, 2, 3, and 4), the model reached high classification accuracies of 58.08%, 55.32%, 69.73%, and 90.21%, respectively. In the ablation study, the MediDRNet model proved to be more effective in feature extraction from diabetic retinal fundus images compared to other feature extraction methods. Conclusions: This study employed prototype contrastive learning and bidirectional branch learning strategies, successfully constructing a grading system for diabetic retinopathy lesions within imbalanced diabetic retinopathy datasets. Through a dual -branch network, the feature learning branch effectively facilitated a smooth transition of features from the grading network to the classification learning branch, accurately identifying minority sample categories. This method not only effectively resolved the issue of sample imbalance but also provided strong support for the precise grading and early diagnosis of diabetic retinopathy in clinical applications, showcasing exceptional performance in handling complex diabetic retinopathy datasets. Moreover, this research significantly improved the efficiency of prevention and management of disease
引用
收藏
页数:10
相关论文
共 50 条
[31]   Diagnosis of Diabetic Retinopathy Using Machine Learning Classification Algorithm [J].
Bhatia, Karan ;
Arora, Shikhar ;
Tomar, Ravi .
PROCEEDINGS ON 2016 2ND INTERNATIONAL CONFERENCE ON NEXT GENERATION COMPUTING TECHNOLOGIES (NGCT), 2016, :347-351
[32]   Early Detection and Classification of Diabetic Retinopathy: A Deep Learning Approach [J].
Youldash, Mustafa ;
Rahman, Atta ;
Alsayed, Manar ;
Sebiany, Abrar ;
Alzayat, Joury ;
Aljishi, Noor ;
Alshammari, Ghaida ;
Alqahtani, Mona .
AI, 2024, 5 (04) :2586-2617
[33]   Analysis of Deep Learning Performance for Diabetic Retinopathy Severity Classification [J].
Tan, Yan Fang ;
Yazid, Haniza ;
Basaruddin, Khairul Salleh ;
Basah, Shafriza Nisha .
INTELLIGENT MANUFACTURING AND MECHATRONICS, SIMM 2023, 2024, :129-148
[34]   Classification of diabetic retinopathy severity level using deep learning [J].
Durairaj, Santhi ;
Subramanian, Parvathi ;
Swamy, Carmel Sobia Micheal .
INTERNATIONAL JOURNAL OF DIABETES IN DEVELOPING COUNTRIES, 2024, 44 (03) :592-598
[35]   Deep learning-enhanced diabetic retinopathy image classification [J].
Alwakid, Ghadah ;
Gouda, Walaa ;
Humayun, Mamoona ;
Jhanjhi, Noor Zaman .
DIGITAL HEALTH, 2023, 9
[36]   An active learning method for diabetic retinopathy classification with uncertainty quantification [J].
Muhammad Ahtazaz Ahsan ;
Adnan Qayyum ;
Adeel Razi ;
Junaid Qadir .
Medical & Biological Engineering & Computing, 2022, 60 :2797-2811
[37]   Diabetic Retinopathy Classification Using Hybrid Deep Learning Approach [J].
Menaouer B. ;
Dermane Z. ;
El Houda Kebir N. ;
Matta N. .
SN Computer Science, 3 (5)
[38]   Comparative performance of deep learning architectures in classification of diabetic retinopathy [J].
Krishnan, S. Hari ;
Vishwa, Charen ;
Suchetha, M. ;
Raman, Akshay ;
Raman, Rajiv ;
Sehastrajit, S. ;
Dhas, D. Edwin .
INTERNATIONAL JOURNAL OF AD HOC AND UBIQUITOUS COMPUTING, 2023, 44 (01) :23-35
[39]   An adaptive weighted ensemble learning network for diabetic retinopathy classification [J].
Wu, Panpan ;
Qu, Yue ;
Zhao, Ziping ;
Cui, Yue ;
Xu, Yurou ;
An, Peng ;
Yu, Hengyong .
JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY, 2024, 32 (02) :285-301
[40]   Diabetic Retinopathy Images Classification via Multiple Instance Learning [J].
Vocaturo, Eugenio ;
Zumpano, Ester .
2021 IEEE/ACM CONFERENCE ON CONNECTED HEALTH: APPLICATIONS, SYSTEMS AND ENGINEERING TECHNOLOGIES (CHASE 2021), 2021, :143-148