Dual Encoder-Based Dynamic-Channel Graph Convolutional Network With Edge Enhancement for Retinal Vessel Segmentation

被引:109
作者
Li, Yang [1 ]
Zhang, Yue [1 ]
Cui, Weigang [1 ]
Lei, Baiying [2 ]
Kuang, Xihe [3 ]
Zhang, Teng [3 ]
机构
[1] Beihang Univ, Sch Automat Sci & Elect Engn, Beijing 100190, Peoples R China
[2] Shenzhen Univ, Sch Biomed Engn, Natl Reg Key Technol Engn Lab Med Ultrasound, Shenzhen 518060, Guangdong, Peoples R China
[3] Univ Hong Kong, Fac Med, Dept Orthopaed & Traumatol, Hong Kong, Peoples R China
基金
中国国家自然科学基金; 北京市自然科学基金;
关键词
Image edge detection; Biomedical imaging; Image segmentation; Feature extraction; Deep learning; Convolution; Decoding; Retinal vessel segmentation; dual encoder; dynamic graph convolution network; edge enhancement; deep learning; BLOOD-VESSELS; U-NET; INTEREST RECONSTRUCTION; NEURAL-NETWORKS; FEATURE FUSION; IMAGES; REGION; CONNECTIVITY; ALGORITHM; MODEL;
D O I
10.1109/TMI.2022.3151666
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Retinal vessel segmentation with deep learning technology is a crucial auxiliary method for clinicians to diagnose fundus diseases. However, the deep learning approaches inevitably lose the edge information, which contains spatial features of vessels while performing down-sampling, leading to the limited segmentation performance of fine blood vessels. Furthermore, the existing methods ignore the dynamic topological correlations among feature maps in the deep learning framework, resulting in the inefficient capture of the channel characterization. To address these limitations, we propose a novel dual encoder-based dynamic-channel graph convolutional network with edge enhancement (DE-DCGCN-EE) for retinal vessel segmentation. Specifically, we first design an edge detection-based dual encoder to preserve the edge of vessels in down-sampling. Secondly, we investigate a dynamic-channel graph convolutional network to map the image channels to the topological space and synthesize the features of each channel on the topological map, which solves the limitation of insufficient channel information utilization. Finally, we study an edge enhancement block, aiming to fuse the edge and spatial features in the dual encoder, which is beneficial to improve the accuracy of fine blood vessel segmentation. Competitive experimental results on five retinal image datasets validate the efficacy of the proposed DE-DCGCN-EE, which achieves more remarkable segmentation results against the other state-of-the-art methods, indicating its potential clinical application.
引用
收藏
页码:1975 / 1989
页数:15
相关论文
共 76 条
[1]  
Abramoff Michael D, 2010, IEEE Rev Biomed Eng, V3, P169, DOI 10.1109/RBME.2010.2084567
[2]  
[Anonymous], 2017, P INT C LEARN REPR T
[3]  
[Anonymous], 1983, Image Vis. Comput, DOI [DOI 10.1016/0262-8856(83)90006-9, https://doi.org/10.1016/0262-8856(83)90006-9]
[4]   Semantic Segmenation of Pathological Lung Tissue With Dilated Fully Convolutional Networks [J].
Anthimopoulos, Marios ;
Christodoulidis, Stergios ;
Ebner, Lukas ;
Geiser, Thomas ;
Christe, Andreas ;
Mougiakakou, Stavroula .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (02) :714-722
[5]   DETECTION OF BLOOD-VESSELS IN RETINAL IMAGES USING TWO-DIMENSIONAL MATCHED-FILTERS [J].
CHAUDHURI, S ;
CHATTERJEE, S ;
KATZ, N ;
NELSON, M ;
GOLDBAUM, M .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1989, 8 (03) :263-269
[6]   Label Co-Occurrence Learning With Graph Convolutional Networks for Multi-Label Chest X-Ray Image Classification [J].
Chen, Bingzhi ;
Li, Jinxing ;
Lu, Guangming ;
Yu, Hongbing ;
Zhang, David .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2020, 24 (08) :2292-2302
[7]   Structure-Driven Unsupervised Domain Adaptation for Cross-Modality Cardiac Segmentation [J].
Cui, Zhiming ;
Li, Changjian ;
Du, Zhixu ;
Chen, Nenglun ;
Wei, Guodong ;
Chen, Runnan ;
Yang, Lei ;
Shen, Dinggang ;
Wang, Wenping .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (12) :3604-3616
[8]   Weakly-Supervised Vessel Detection in Ultra-Widefield Fundus Photography via Iterative Multi-Modal Registration and Learning [J].
Ding, Li ;
Kuriyan, Ajay E. ;
Ramchandran, Rajeev S. ;
Wykoff, Charles C. ;
Sharma, Gaurav .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) :2748-2758
[9]   A Hierarchical Image Matting Model for Blood Vessel Segmentation in Fundus Images [J].
Fan, Zhun ;
Lu, Jiewei ;
Wei, Caimin ;
Huang, Han ;
Cai, Xinye ;
Chen, Xinjian .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (05) :2367-2377
[10]   An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel Segmentation [J].
Fraz, Muhammad Moazam ;
Remagnino, Paolo ;
Hoppe, Andreas ;
Uyyanonvara, Bunyarit ;
Rudnicka, Alicja R. ;
Owen, Christopher G. ;
Barman, Sarah A. .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2012, 59 (09) :2538-2548