SEMI-SUPERVISED AND SELF-SUPERVISED COLLABORATIVE LEARNING FOR PROSTATE 3D MR IMAGE SEGMENTATION

被引:0
作者
Osman, Yousuf Babiker M. [1 ,2 ]
Li, Cheng [1 ]
Huang, Weijian [1 ,2 ]
Elsayed, Nazik [1 ,2 ,4 ]
Ying, Leslie [5 ,6 ]
Zheng, Hairong [1 ]
Wang, Shanshan [1 ,3 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Paul C Lauterbur Res Ctr Biomed Imaging, Shenzhen, Guangdong, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 3, Peoples R China
[3] Guangdong Prov Key Lab Artificial Intelligence Me, Guangzhou, Guangdong, Peoples R China
[4] Univ Gezira, Fac Math & Comp Sci, Wad Madani, Sudan
[5] SUNY Buffalo, Dept Biomed Engn, New York, NY USA
[6] SUNY Buffalo, Dept Elect Engn, New York, NY USA
来源
2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI | 2023年
基金
中国国家自然科学基金;
关键词
Semi-Supervised Learning; Self-Supervised Learning; Pseudo Labeling; Sparse Annotation;
D O I
10.1109/ISBI53787.2023.10230326
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Volumetric magnetic resonance (MR) image segmentation plays an important role in many clinical applications. Deep learning (DL) has recently achieved state-of-the-art or even human-level performance on various image segmentation tasks. Nevertheless, manually annotating volumetric MR images for DL model training is labor-exhaustive and time-consuming. In this work, we aim to train a semi-supervised and self-supervised collaborative learning framework for prostate 3D MR image segmentation while using extremely sparse annotations, for which the ground truth annotations are provided for just the central slice of each volumetric MR image. Specifically, semi-supervised learning and self-supervised learning methods are used to generate two independent sets of pseudo labels. These pseudo labels are then fused by the Boolean operation to extract a more confident pseudo label set. The images with either manual or network self-generated labels are then employed to train a segmentation model for target volume extraction. Experimental results on a publicly available prostate MR image dataset demonstrate that, while requiring significantly less annotation effort, our framework generates very encouraging segmentation results. The proposed framework is very useful in clinical applications when training data with dense annotations are difficult to obtain.
引用
收藏
页数:4
相关论文
共 18 条
[1]   U-Net: deep learning for cell counting, detection, and morphometry [J].
Falk, Thorsten ;
Mai, Dominic ;
Bensch, Robert ;
Cicek, Oezguen ;
Abdulkadir, Ahmed ;
Marrakchi, Yassine ;
Boehm, Anton ;
Deubner, Jan ;
Jaeckel, Zoe ;
Seiwald, Katharina ;
Dovzhenko, Alexander ;
Tietz, Olaf ;
Dal Bosco, Cristina ;
Walsh, Sean ;
Saltukoglu, Deniz ;
Tay, Tuan Leng ;
Prinz, Marco ;
Palme, Klaus ;
Simons, Matias ;
Diester, Ilka ;
Brox, Thomas ;
Ronneberger, Olaf .
NATURE METHODS, 2019, 16 (01) :67-+
[2]   CE-Net: Context Encoder Network for 2D Medical Image Segmentation [J].
Gu, Zaiwang ;
Cheng, Jun ;
Fu, Huazhu ;
Zhou, Kang ;
Hao, Huaying ;
Zhao, Yitian ;
Zhang, Tianyang ;
Gao, Shenghua ;
Liu, Jiang .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) :2281-2292
[3]   A Coarse-to-Fine Deformable Transformation Framework for Unsupervised Multi-Contrast MR Image Registration with Dual Consistency Constraint [J].
Huang, Weijian ;
Yang, Hao ;
Liu, Xinfeng ;
Li, Cheng ;
Zhang, Ian ;
Wang, Rongpin ;
Zheng, Hairong ;
Wang, Shanshan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (10) :2589-2599
[4]   nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation [J].
Isensee, Fabian ;
Jaeger, Paul F. ;
Kohl, Simon A. A. ;
Petersen, Jens ;
Maier-Hein, Klaus H. .
NATURE METHODS, 2021, 18 (02) :203-+
[5]  
Lee Dong-Hyun, 2013, WORKSHOP CHALLENGES, P2
[6]   Artificial intelligence in multiparametric magnetic resonance imaging: A review [J].
Li, Cheng ;
Li, Wen ;
Liu, Chenyang ;
Zheng, Hairong ;
Cai, Jing ;
Wang, Shanshan .
MEDICAL PHYSICS, 2022, 49 (10) :E1024-E1054
[7]   Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge [J].
Litjens, Geert ;
Toth, Robert ;
van de Ven, Wendy ;
Hoeks, Caroline ;
Kerkstra, Sjoerd ;
van Ginneken, Bram ;
Vincent, Graham ;
Guillard, Gwenael ;
Birbeck, Neil ;
Zhang, Jindang ;
Strand, Robin ;
Malmberg, Filip ;
Ou, Yangming ;
Davatzikos, Christos ;
Kirschner, Matthias ;
Jung, Florian ;
Yuan, Jing ;
Qiu, Wu ;
Gao, Qinquan ;
Edwards, Philip Eddie ;
Maan, Bianca ;
van der Heijden, Ferdinand ;
Ghose, Soumya ;
Mitra, Jhimli ;
Dowling, Jason ;
Barratt, Dean ;
Huisman, Henkjan ;
Madabhushi, Anant .
MEDICAL IMAGE ANALYSIS, 2014, 18 (02) :359-373
[8]   3D UNSUPERVISED KIDNEY GRAFT SEGMENTATION BASED ON DEEP LEARNING AND MULTI-SEQUENCE MRI [J].
Milecki, Leo ;
Bodard, Sylvain ;
Correas, Jean-Michel ;
Timsit, Marc-Olivier ;
Vakalopoulou, Maria .
2021 IEEE 18TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2021, :1781-1785
[9]  
Peng JL., 2020, Pattern Recogn, V107
[10]  
Tarvainen A, 2017, ADV NEUR IN, V30