Reconstruction-Driven Dynamic Refinement Based Unsupervised Domain Adaptation for Joint Optic Disc and Cup Segmentation

被引:14
作者
Chen, Ziyang [1 ]
Pan, Yongsheng [2 ]
Xia, Yong [1 ]
机构
[1] Northwestern Polytech Univ, Natl Engn Lab Ingrated Aero Space Ground Ocean Bi, Sch Comp Sci & Engn, Xian 710072, Peoples R China
[2] Shanghai Tech Univ, Sch Biomed & Engn, Shanghai 201210, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Dynamic convolution; fundus images; joint optic disc and optic cup segmentation; unsupervised domain adaption; GLAUCOMA;
D O I
10.1109/JBHI.2023.3266576
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Glaucoma is one of the leading causes of irreversible blindness. Segmentation of optic disc (OD) and optic cup (OC) on fundus images is a crucial step in glaucoma screening. Although many deep learning models have been constructed for this task, it remains challenging to train an OD/OC segmentation model that could be deployed successfully to different healthcare centers. The difficulties mainly comes from the domain shift issue, i.e., the fundus images collected at these centers usually vary greatly in the tone, contrast, and brightness. To address this issue, in this paper, we propose a novel unsupervised domain adaptation (UDA) method called Reconstruction-driven Dynamic Refinement Network (RDR-Net), where we employ a due-path segmentation backbone for simultaneous edge detection and region prediction and design three modules to alleviate the domain gap. The reconstruction alignment (RA) module uses a variational auto-encoder (VAE) to reconstruct the input image and thus boosts the image representation ability of the network in a self-supervised way. It also uses a style-consistency constraint to force the network to retain more domain-invariant information. The low-level feature refinement (LFR) module employs input-specific dynamic convolutions to suppress the domain-variant information in the obtained low-level features. The prediction-map alignment (PMA) module elaborates the entropy-driven adversarial learning to encourage the network to generate source-like boundaries and regions. We evaluated our RDR-Net against state-of-the-art solutions on four public fundus image datasets. Our results indicate that RDR-Net is superior to competing models in both segmentation performance and generalization ability.
引用
收藏
页码:3537 / 3548
页数:12
相关论文
共 55 条
[1]  
Cardace A., 2022, P IEEECVF WINTER C A, P1160
[2]   All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation [J].
Chang, Wei-Lun ;
Wang, Hui-Po ;
Peng, Wen-Hsiao ;
Chiu, Wei-Chen .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1900-1909
[3]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[4]   Domain Adaptation for Semantic Segmentation with Maximum Squares Loss [J].
Chen, Minghao ;
Xue, Hongyang ;
Cai, Deng .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2090-2099
[5]   Dynamic Convolution: Attention over Convolution Kernels [J].
Chen, Yinpeng ;
Dai, Xiyang ;
Liu, Mengchen ;
Chen, Dongdong ;
Yuan, Lu ;
Liu, Zicheng .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :11027-11036
[6]   Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma Screening [J].
Cheng, Jun ;
Liu, Jiang ;
Xu, Yanwu ;
Yin, Fengshou ;
Wong, Damon Wing Kee ;
Tan, Ngan-Meng ;
Tao, Dacheng ;
Cheng, Ching-Yu ;
Aung, Tin ;
Wong, Tien Yin .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2013, 32 (06) :1019-1032
[7]  
De Brabandere B, 2016, ADV NEUR IN, V29
[8]  
Doersch C, 2021, Arxiv, DOI arXiv:1606.05908
[9]   Domain adaptation based on domain-invariant and class-distinguishable feature learning using multiple adversarial networks [J].
Fan, Cangning ;
Liu, Peng ;
Xiao, Ting ;
Zhao, Wei ;
Tang, Xianglong .
NEUROCOMPUTING, 2020, 411 :178-192
[10]   Joint Optic Disc and Cup Segmentation Based on Multi-Label Deep Network and Polar Transformation [J].
Fu, Huazhu ;
Cheng, Jun ;
Xu, Yanwu ;
Wong, Damon Wing Kee ;
Liu, Jiang ;
Cao, Xiaochun .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (07) :1597-1605