Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization

被引:16
作者
Chen, Qi-Qi [1 ]
Sun, Zhao-Hui [2 ]
Wei, Chuan-Feng [3 ]
Wu, Edmond Q. [4 ,5 ]
Ming, Dong [6 ,7 ]
机构
[1] Shanghai Jiao Tong Univ, Dept Automat, Shanghai 200240, Peoples R China
[2] Shanghai Jiao Tong Univ, Sch Mech Engn, Shanghai 200240, Peoples R China
[3] CAST, Inst Manned Space Syst Engn, Human Space Flight Syst Engn Div, Beijing 100094, Peoples R China
[4] Shanghai Jiao Tong Univ, Key Lab Syst Control & Informat Proc, Minist Educ, Shanghai 200240, Peoples R China
[5] Natl Aeronaut Radio Elect Res Inst, Sci & Technol Av Integrat Lab, Shanghai 200240, Peoples R China
[6] Tianjin Univ, Acad Med Engn & Translat Med, Tianjin 300072, Peoples R China
[7] Tianjin Univ, Coll Precis Instruments & Optoelect Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
Semi-supervised learning; 3D medical image segmentation; dual-task joint; consistency loss; BRAIN-TUMOR SEGMENTATION; ATLAS-BASED SEGMENTATION; MODEL; NETWORKS;
D O I
10.1109/TCBB.2022.3144428
中图分类号
Q5 [生物化学];
学科分类号
071010 ; 081704 ;
摘要
Semi-supervised learning has attracted wide attention from many researchers since its ability to utilize a few data with labels and relatively more data without labels to learn information. Some existing semi-supervised methods for medical image segmentation enforce the regularization of training by implicitly perturbing data or networks to perform the consistency. Most consistency regularization methods focus on data level or network structure level, and rarely of them focus on the task level. It may not directly lead to an improvement in task accuracy. To overcome the problem, this work proposes a semi-supervised dual-task consistent joint learning framework with task-level regularization for 3D medical image segmentation. Two branches are utilized to simultaneously predict the segmented and signed distance maps, and they can learn useful information from each other by constructing a consistency loss function between the two tasks. The segmentation branch learns rich information from both labeled and unlabeled data to strengthen the constraints on the geometric structure of the target. Experimental results on two benchmark datasets show that the proposed method can achieve better performance compared with other state-of-the-art works. It illustrates our method improves segmentation performance by utilizing unlabeled data and consistent regularization.
引用
收藏
页码:2457 / 2467
页数:11
相关论文
共 58 条
[1]   Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions [J].
Akkus, Zeynettin ;
Galimzianova, Alfiia ;
Hoogi, Assaf ;
Rubin, Daniel L. ;
Erickson, Bradley J. .
JOURNAL OF DIGITAL IMAGING, 2017, 30 (04) :449-459
[2]   Deep semantic segmentation of natural and medical images: a review [J].
Asgari Taghanaki, Saeid ;
Abhishek, Kumar ;
Cohen, Joseph Paul ;
Cohen-Adad, Julien ;
Hamarneh, Ghassan .
ARTIFICIAL INTELLIGENCE REVIEW, 2021, 54 (01) :137-178
[3]   Semi-supervised Medical Image Segmentation via Learning Consistency Under Transformations [J].
Bortsova, Gerda ;
Dubost, Florian ;
Hogeweg, Laurens ;
Katramados, Ioannis ;
de Bruijne, Marleen .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2019, PT VI, 2019, 11769 :810-818
[4]   Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation [J].
Brosch, Tom ;
Tang, Lisa Y. W. ;
Yoo, Youngjin ;
Li, David K. B. ;
Traboulsee, Anthony ;
Tam, Roger .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (05) :1229-1239
[5]   Uncertainty Aware Temporal-Ensembling Model for Semi-Supervised ABUS Mass Segmentation [J].
Cao, Xuyang ;
Chen, Houjin ;
Li, Yanfeng ;
Peng, Yahui ;
Wang, Shu ;
Cheng, Lin .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2021, 40 (01) :431-443
[6]   Multi-modality fusion learning for the automatic diagnosis of optic neuropathy [J].
Cao, Zheng ;
Sun, Chuanbin ;
Wang, Wenzhe ;
Zheng, Xiangshang ;
Wu, Jian ;
Gao, Honghao .
PATTERN RECOGNITION LETTERS, 2021, 142 :58-64
[7]   A Transfer Learning Based Super-Resolution Microscopy for Biopsy Slice Images: The Joint Methods Perspective [J].
Chen, Jintai ;
Ying, Haochao ;
Liu, Xuechen ;
Gu, Jingjing ;
Feng, Ruiwei ;
Chen, Tingting ;
Gao, Honghao ;
Wu, Jian .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2021, 18 (01) :103-113
[8]   Discriminative Cervical Lesion Detection in Colposcopic Images With Global Class Activation and Local Bin Excitation [J].
Chen, Tingting ;
Liu, Xuechen ;
Feng, Ruiwei ;
Wang, Wenzhe ;
Yuan, Chunnv ;
Lu, Weiguo ;
He, Haizhen ;
Gao, Honghao ;
Ying, Haochao ;
Chen, Danny Z. ;
Wu, Jian .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (04) :1411-1421
[9]   Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis [J].
Cheplygina, Veronika ;
de Bruijne, Marleen ;
Pluim, Josien P. W. .
MEDICAL IMAGE ANALYSIS, 2019, 54 :280-296
[10]   Dense deformation field estimation for atlas-based segmentation of pathological MR brain images [J].
Cuadra, M. Bach ;
De Craene, M. ;
Duay, V. ;
Macq, B. ;
Pollo, C. ;
Thiran, J. -Ph. .
COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2006, 84 (2-3) :66-75