Lightweight Frequency Recalibration Network for Diabetic Retinopathy Multi-Lesion Segmentation

被引:6
作者
Fu, Yinghua [1 ]
Liu, Mangmang [1 ]
Zhang, Ge [1 ]
Peng, Jiansheng [2 ]
机构
[1] Univ Shanghai Sci & Technol, Sch Opt Elect & Comp Engn, Shanghai 200093, Peoples R China
[2] Hechi Univ, Dept Artificial Intelligence & Mfg, Hechi 546300, Peoples R China
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 16期
基金
中国国家自然科学基金;
关键词
diabetic retinopathy; segmentation; LFRC-Net; RAM; U-NET;
D O I
10.3390/app14166941
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Automated segmentation of diabetic retinopathy (DR) lesions is crucial for assessing DR severity and diagnosis. Most previous segmentation methods overlook the detrimental impact of texture information bias, resulting in suboptimal segmentation results. Additionally, the role of lesion shape is not thoroughly considered. In this paper, we propose a lightweight frequency recalibration network (LFRC-Net) for simultaneous multi-lesion DR segmentation, which integrates a frequency recalibration module into the bottleneck layers of the encoder to analyze texture information and shape features together. The module utilizes a Gaussian pyramid to generate features at different scales, constructs a Laplacian pyramid using a difference of Gaussian filter, and then analyzes object features in different frequency domains with the Laplacian pyramid. The high-frequency component handles texture information, while the low-frequency area focuses on learning the shape features of DR lesions. By adaptively recalibrating these frequency representations, our method can differentiate the objects of interest. In the decoder, we introduce a residual attention module (RAM) to enhance lesion feature extraction and efficiently suppress irrelevant information. We evaluate the proposed model's segmentation performance on two public datasets, IDRiD and DDR, and a private dataset, an ultra-wide-field fundus images dataset. Extensive comparative experiments and ablation studies are conducted across multiple datasets. With minimal model parameters, our approach achieves an mAP_PR of 60.51%, 34.83%, and 14.35% for the segmentation of EX, HE, and MA on the DDR dataset and also obtains excellent results for EX and SE on the IDRiD dataset, which validates the effectiveness of our network.
引用
收藏
页数:20
相关论文
共 42 条
[1]  
Ameri Nafise, 2022, 2022 12th International Conference on Computer and Knowledge Engineering (ICCKE), P123, DOI 10.1109/ICCKE57176.2022.9960101
[2]   Deep Frequency Re-calibration U-Net for Medical Image Segmentation [J].
Azad, Reza ;
Bozorgpour, Afshin ;
Asadi-Aghbolaghi, Maryam ;
Merhof, Dorit ;
Escalera, Sergio .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :3267-3276
[3]   On the Texture Bias for Few-Shot CNN Segmentation [J].
Azad, Reza ;
Fayjie, Abdur R. ;
Kauffmann, Claude ;
Ben Ayed, Ismail ;
Pedersoli, Marco ;
Dolz, Jose .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :2673-2682
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   DR-Net: Diabetic Retinopathy detection with fusion multi-lesion segmentation and classification [J].
Chen, Yu ;
Xu, Shibao ;
Long, Jun ;
Xie, Yining .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (17) :26919-26935
[6]  
Chu-Hui Lee, 2021, ICCMS '21: 2021 The 13th International Conference on Computer Modeling and Simulation, P264, DOI 10.1145/3474963.3475849
[7]   Diabetic retinopathy and diabetic macular edema - Pathophysiology, screening, and novel therapies [J].
Ciulla, TA ;
Amador, AG ;
Zinman, B .
DIABETES CARE, 2003, 26 (09) :2653-2664
[8]  
Deng-Ping Fan, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12266), P263, DOI 10.1007/978-3-030-59725-2_26
[9]   Segmentation of hard exudate lesions in color fundus image using two-stage CNN-based methods [J].
Do, Quang Van ;
Hoang, Ha Thu ;
Vu, Nga Van ;
De Jesus, Danilo Andrade ;
Brea, Luisa Sanchez ;
Nguyen, Hiep Xuan ;
Nguyen, Anh Thi Lan ;
Le, Thanh Ngoc ;
Dinh, Dung Thi My ;
Nguyen, Minh Thi Binh ;
Nguyen, Huu Cong ;
Bui, Anh Thi Van ;
Le, Ha Vu ;
Gillen, Kelly ;
Vu, Thom Thi ;
Luu, Ha Manh .
EXPERT SYSTEMS WITH APPLICATIONS, 2024, 241
[10]   TSCA-Net: Transformer based spatial-channel attention segmentation network for medical images [J].
Fu, Yinghua ;
Liu, Junfeng ;
Shi, Jun .
COMPUTERS IN BIOLOGY AND MEDICINE, 2024, 170