MediDRNet: Tackling category imbalance in diabetic retinopathy classification with dual-branch learning and prototypical contrastive learning

被引:0
|
作者
Teng, Siying [1 ]
Wang, Bo [2 ]
Yang, Feiyang [3 ]
Yi, Xingcheng [4 ]
Zhang, Xinmin [5 ]
Sun, Yabin [1 ]
机构
[1] First Hosp Jilin Univ, Dept Ophthalmol, Changchun 130021, Jilin, Peoples R China
[2] Univ Minho, P-4710057 Braga, Braga District, Portugal
[3] Jilin Univ, Coll Comp Sci & Technol, Changchun 130012, Jilin, Peoples R China
[4] First Hosp Jilin Univ, Lab Canc Precis Med, Changchun 130013, Jilin, Peoples R China
[5] Jilin Univ, Sch Pharmaceut Sci, Dept Regenerat Med, Changchun 130021, Jilin, Peoples R China
关键词
Diabetic retinopathy; Imbalanced medical image classification; Prototypical supervised contrastive learning; Dual-branch network; Convolutional block attention module;
D O I
10.1016/j.cmpb.2024.108230
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Background and Objective: The classification of diabetic retinopathy (DR) aims to utilize the implicit information in images for early diagnosis, to prevent and mitigate the further worsening of the condition. However, existing methods are often limited by the need to operate within large, annotated datasets to show significant advantages. Additionally, the number of samples for different categories within the dataset needs to be evenly distributed, because the characteristic of sample imbalance distribution can lead to an excessive focus on high -frequency disease categories, while neglecting the less common but equally important disease categories. Therefore, there is an urgent need to develop a new classification method that can effectively alleviate the issue of sample distribution imbalance, thereby enhancing the accuracy of diabetic retinopathy classification. Methods: In this work, we propose MediDRNet, a dual -branch network model based on prototypical contrastive learning. This model adopts prototype contrastive learning, creating prototypes for different levels of lesions, ensuring they represent the core features of each lesion level. It classifies by comparing the similarity between data points and their category prototypes. Our dual -branch network structure effectively resolves the issue of category imbalance and improves classification accuracy by emphasizing subtle differences in retinal lesions. Moreover, our approach combines a dual -branch network with specific lesion -level prototypes for core feature representation and incorporates the convolutional block attention module for enhanced lesion feature identification. Results: Our experiments using both the Kaggle and UWF classification datasets have demonstrated that MediDRNet exhibits exceptional performance compared to other advanced models in the industry, especially on the UWF DR classification dataset where it achieved state-of-the-art performance across all metrics. On the Kaggle DR classification dataset, it achieved the highest average classification accuracy (0.6327) and Macro -F1 score (0.6361). Particularly in the classification tasks for minority categories of diabetic retinopathy on the Kaggle dataset (Grades 1, 2, 3, and 4), the model reached high classification accuracies of 58.08%, 55.32%, 69.73%, and 90.21%, respectively. In the ablation study, the MediDRNet model proved to be more effective in feature extraction from diabetic retinal fundus images compared to other feature extraction methods. Conclusions: This study employed prototype contrastive learning and bidirectional branch learning strategies, successfully constructing a grading system for diabetic retinopathy lesions within imbalanced diabetic retinopathy datasets. Through a dual -branch network, the feature learning branch effectively facilitated a smooth transition of features from the grading network to the classification learning branch, accurately identifying minority sample categories. This method not only effectively resolved the issue of sample imbalance but also provided strong support for the precise grading and early diagnosis of diabetic retinopathy in clinical applications, showcasing exceptional performance in handling complex diabetic retinopathy datasets. Moreover, this research significantly improved the efficiency of prevention and management of disease
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Dual-Branch Discriminative Transmission Line Bolt Image Classification Based on Contrastive Learning
    Ji, Yan-Peng
    Zhao, Jian-Li
    Liu, Liang-Shuai
    Feng, Hai-Yan
    Du, Jia-Qi
    Fang, Xia
    PROCESSES, 2025, 13 (03)
  • [2] Dual-branch contrastive learning for weakly supervised object localization
    Guo, Zebin
    Li, Dong
    Du, Zhengjun
    Seng, Bingfeng
    APPLIED INTELLIGENCE, 2025, 55 (07)
  • [3] Prototypical contrastive learning for image classification
    Yang, Han
    Li, Jun
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (02): : 2059 - 2069
  • [4] Prototypical contrastive learning for image classification
    Han Yang
    Jun Li
    Cluster Computing, 2024, 27 : 2059 - 2069
  • [5] Dual-branch Branch Networks Based on Contrastive Learning for Long-Tailed Remote Sensing
    Zhang, Lei
    Peng, Lijia
    Xia, Pengfei
    Wei, Chuyuan
    Yang, Chengwei
    Zhang, Yanyan
    PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2024, 90 (01): : 45 - 53
  • [6] Learning a dual-branch classifier for class incremental learning
    Guo, Lei
    Xie, Gang
    Qu, Youyang
    Yan, Gaowei
    Cui, Lei
    APPLIED INTELLIGENCE, 2023, 53 (04) : 4316 - 4326
  • [7] Learning a dual-branch classifier for class incremental learning
    Lei Guo
    Gang Xie
    Youyang Qu
    Gaowei Yan
    Lei Cui
    Applied Intelligence, 2023, 53 : 4316 - 4326
  • [8] Contrastive learning improves representation and transferability of diabetic retinopathy classification models
    Alam, Minhaj Nur
    Leng, Theodore
    Hallak, Joelle
    Rubin, Daniel
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2022, 63 (07)
  • [9] Incremental Learning Based on Dual-Branch Network
    Dong, Mingda
    Zhang, Zhizhong
    Xie, Yuan
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT III, 2024, 14427 : 263 - 272
  • [10] Dual-branch contrastive learning for weakly supervised object localizationDual-branch contrastive learning for weakly supervised object localizationZ. Guo et al.
    Zebin Guo
    Dong Li
    Zhengjun Du
    Bingfeng Seng
    Applied Intelligence, 2025, 55 (7)