Self-supervised Correction Learning for Semi-supervised Biomedical Image Segmentation

被引:23
|
作者
Zhang, Ruifei [1 ]
Liu, Sishuo [2 ]
Yu, Yizhou [2 ,3 ]
Li, Guanbin [1 ,4 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Univ Hong Kong, Pokfulam, Hong Kong, Peoples R China
[3] Deepwise AI Lab, Beijing, Peoples R China
[4] Shenzhen Res Inst Big Data, Shenzhen, Peoples R China
基金
中国国家自然科学基金;
关键词
D O I
10.1007/978-3-030-87196-3_13
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Biomedical image segmentation plays a significant role in computer-aided diagnosis. However, existing CNN based methods rely heavily on massive manual annotations, which are very expensive and require huge human resources. In this work, we adopt a coarse-to-fine strategy and propose a self-supervised correction learning paradigm for semi-supervised biomedical image segmentation. Specifically, we design a dual-task network, including a shared encoder and two independent decoders for segmentation and lesion region inpainting, respectively. In the first phase, only the segmentation branch is used to obtain a relatively rough segmentation result. In the second step, we mask the detected lesion regions on the original image based on the initial segmentation map, and send it together with the original image into the network again to simultaneously perform inpainting and segmentation separately. For labeled data, this process is supervised by the segmentation annotations, and for unlabeled data, it is guided by the inpainting loss of masked lesion regions. Since the two tasks rely on similar feature information, the unlabeled data effectively enhances the representation of the network to the lesion regions and further improves the segmentation performance. Moreover, a gated feature fusion (GFF) module is designed to incorporate the complementary features from the two tasks. Experiments on three medical image segmentation datasets for different tasks including polyp, skin lesion and fundus optic disc segmentation well demonstrate the outstanding performance of our method compared with other semi-supervised approaches. The code is available at https://github.com/ReaFly/SemiMedSeg.
引用
收藏
页码:134 / 144
页数:11
相关论文
共 50 条
  • [1] SEMI-SUPERVISED AND SELF-SUPERVISED COLLABORATIVE LEARNING FOR PROSTATE 3D MR IMAGE SEGMENTATION
    Osman, Yousuf Babiker M.
    Li, Cheng
    Huang, Weijian
    Elsayed, Nazik
    Ying, Leslie
    Zheng, Hairong
    Wang, Shanshan
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,
  • [2] Self-Supervised Learning for Annotation Efficient Biomedical Image Segmentation
    Rettenberger, Luca
    Schilling, Marcel
    Elser, Stefan
    Bohland, Moritz
    Reischl, Markus
    IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2023, 70 (09) : 2519 - 2528
  • [3] S6: SEMI-SUPERVISED SELF-SUPERVISED SEMANTIC SEGMENTATION
    Soliman, Moamen
    Lehman, Charles
    AlRegib, Ghassan
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 1861 - 1865
  • [4] Self-Supervised Sequence Recovery for Semi-Supervised Retinal Layer Segmentation
    Yang, Jiadong
    Tao, Yuhui
    Xu, Qiuzhuo
    Zhang, Yuhan
    Ma, Xiao
    Yuan, Songtao
    Chen, Qiang
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (08) : 3872 - 3883
  • [5] Self-supervised Learning for Semi-supervised Time Series Classification
    Jawed, Shayan
    Grabocka, Josif
    Schmidt-Thieme, Lars
    ADVANCES IN KNOWLEDGE DISCOVERY AND DATA MINING, PAKDD 2020, PT I, 2020, 12084 : 499 - 511
  • [6] Self-Supervised and Semi-Supervised Polyp Segmentation using Synthetic Data
    Moreu, Enric
    Arazo, Eric
    McGuinness, Kevin
    O'Connor, Noel E.
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [7] Self-Supervised Learning for Semi-Supervised Temporal Language Grounding
    Luo, Fan
    Chen, Shaoxiang
    Chen, Jingjing
    Wu, Zuxuan
    Jiang, Yu-Gang
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7747 - 7757
  • [8] Self-Supervised Learning for Semi-Supervised Temporal Action Proposal
    Wang, Xiang
    Zhang, Shiwei
    Qing, Zhiwu
    Shao, Yuanjie
    Gao, Changxin
    Sang, Nong
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 1905 - 1914
  • [9] Semi-supervised learning made simple with self-supervised clustering
    Fini, Enrico
    Astolfi, Pietro
    Alahari, Karteek
    Alameda-Meda, Xavier
    Mairal, Julien
    Nabi, Moin
    Ricci, Elisa
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 3187 - 3197
  • [10] Self-supervised learning and semi-supervised learning for multi-sequence medical image classification
    Wang, Yueyue
    Song, Danjun
    Wang, Wentao
    Rao, Shengxiang
    Wang, Xiaoying
    Wang, Manning
    NEUROCOMPUTING, 2022, 513 : 383 - 394