Retinal vessel segmentation based on self-distillation and implicit neural representation

被引:6
作者
Gu, Jia [1 ]
Tian, Fangzheng [1 ]
Oh, Il-Seok [1 ,2 ]
机构
[1] Jeonbuk Natl Univ, Div Comp Sci & Engn, 567 Baekje Daero, Jeonju 54896, South Korea
[2] Jeonbuk Natl Univ, Ctr Adv Image Informat Technol, 567 Baekje Daero, Jeonju 54896, South Korea
基金
英国科研创新办公室;
关键词
Retinal vessel segmentation; Neural networks; Self-distillation; Implicit neural representation; Texture enhancement; FUNDUS IMAGES; NETWORK; NET;
D O I
10.1007/s10489-022-04252-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Segmenting retinal blood vessels from retinal images is a crucial step in ocular disease diagnosis. It is also one of the most important applications and research in ophthalmic image analysis. However, the contrast between the retinal vessels and background in fundus images is low. The size and shape of retinal vessels vary significantly, and the width of some small vessels is often below 10 pixels or even 1 pixel. Moreover, some blood vessels are discontinuous owing to illumination, which complicates the segmentation of retinal blood vessels. To address these problems, this paper innovatively proposes a novel retinal vessel segmentation network framework based on self-distillation and implicit neural representation, which predicts retinal vessels in two stages. First, the self-distillation method extracts the main features of retinal images using the properties of Vision Transformer (ViT) to obtain preliminary images for the blood vessel segmentation. Second, implicit neural representation improves the resolution of the original retinal image, and the details of blood vessels are enhanced through the texture enhancement module to obtain accurate results of the blood vessel segmentation. Furthermore, we adopted an improved centerline dice (clDice) loss function to constrain the topology of blood vessels. We experimented on two benchmark retinal datasets (i.e., Drive and Chase) to quantitatively and qualitatively analyze the proposed method. The results indicate that the proposed outperformed the mainstream baseline. The visual segmentation results also show that this method can segment thin blood vessels more accurately and ensure the continuity of blood vessels.
引用
收藏
页码:15027 / 15044
页数:18
相关论文
共 61 条
[1]   Fast and efficient retinal blood vessel segmentation method based on deep learning network* [J].
Boudegga, Henda ;
Elloumi, Yaroub ;
Akil, Mohamed ;
Bedoui, Mohamed Hedi ;
Kachouri, Rostom ;
Ben Abdallah, Asma .
COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2021, 90
[2]   Emerging Properties in Self-Supervised Vision Transformers [J].
Caron, Mathilde ;
Touvron, Hugo ;
Misra, Ishan ;
Jegou, Herve ;
Mairal, Julien ;
Bojanowski, Piotr ;
Joulin, Armand .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :9630-9640
[3]   Learning Continuous Image Representation with Local Implicit Image Function [J].
Chen, Yinbo ;
Liu, Sifei ;
Wang, Xiaolong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :8624-8634
[4]   Illuminationnormalized based technique for retinal blood vessel segmentation [J].
Dash, Sonali ;
Senapati, Manas Ranjan ;
Sahu, Pradip Kumar ;
Chowdary, P. S. R. .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2021, 31 (01) :351-363
[5]   RFNet: Region-aware Fusion Network for Incomplete Multi-modal Brain Tumor Segmentation [J].
Ding, Yuhang ;
Yu, Xin ;
Yang, Yi .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :3955-3964
[6]  
Dosovitskiy A., 2021, P INT C LEARN REPR, DOI DOI 10.48550/ARXIV.2010.11929
[7]   An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation [J].
Fraz, Muhammad Moazam ;
Remagnino, Paolo ;
Hoppe, Andreas ;
Uyyanonvara, Bunyarit ;
Rudnicka, Alicja R. ;
Owen, Christopher G. ;
Barman, Sarah A. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (09) :2538-2548
[8]   Residual learning based CNN for breast cancer histopathological image classification [J].
Gour, Mahesh ;
Jain, Sweta ;
Kumar, T. Sunil .
INTERNATIONAL JOURNAL OF IMAGING SYSTEMS AND TECHNOLOGY, 2020, 30 (03) :621-635
[9]   SA-UNet: Spatial Attention U-Net for Retinal Vessel Segmentation [J].
Guo, Changlu ;
Szemenyei, Marton ;
Yi, Yugen ;
Wang, Wenle ;
Chen, Buer ;
Fan, Changqi .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :1236-1242
[10]   UNETR: Transformers for 3D Medical Image Segmentation [J].
Hatamizadeh, Ali ;
Tang, Yucheng ;
Nath, Vishwesh ;
Yang, Dong ;
Myronenko, Andriy ;
Landman, Bennett ;
Roth, Holger R. ;
Xu, Daguang .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :1748-1758