Semantic knowledge transfer for semi-supervised medical image segmentation

被引:0
作者
Zhou, Shiwei [1 ,2 ,3 ]
Zhao, Haifeng [1 ,2 ,3 ]
Ma, Leilei [1 ,2 ,3 ]
Sun, Dengdi [4 ,5 ]
机构
[1] Anhui Univ, Key Lab Intelligent Comp & Signal Proc ICSP, Minist Educ, Hefei 230601, Peoples R China
[2] Anhui Univ, Anhui Prov Key Lab Multimodal Cognit Computat, Hefei 230601, Peoples R China
[3] Anhui Univ, Sch Comp Sci & Technol, Hefei 230601, Peoples R China
[4] Anhui Univ, Sch Artificial Intelligence, Hefei 230601, Peoples R China
[5] Hefei Comprehens Natl Sci Ctr, Inst Artificial Intelligence, Hefei 230026, Peoples R China
基金
中国国家自然科学基金;
关键词
Medical image segmentation; Semi-supervised learning; Contrastive learning; Semantic knowledge transfer;
D O I
10.1016/j.engappai.2025.111235
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In semi-supervised medical image segmentation, due to possible differences in information content and distribution between labeled and unlabeled data, dealing with the two separately usually prevents knowledge transfer from labeled to unlabeled data. This prevents the model from effectively sharing learned information between the two types of data. To alleviate this problem, we train labeled and unlabeled data as a whole. Semantic mixing of labeled and unlabeled data is achieved by selecting and exchanging some of the region images of both through a mask to generate complementary input views. In addition, due to the limited labeled data, the unlabeled data has a weak ability to distinguish categories in the feature space. Traditional methods rely on pixel positions to generate positive and negative samples for contrastive learning to solve this problem, but relying on pixel position sampling can easily lead to semantic inconsistency, which affects the effect of feature learning; therefore, to address this problem, we propose an innovative labeled data-guided interclass contrastive learning strategy, which extracts the category features from labeled and unlabeled data and exploits the accurate category information in the labeled data to guide contrastive learning, while introducing a similarity-based ranking weighting mechanism. Combining the two designs, we propose a new semantic knowledge transfer framework for semi-supervised medical image segmentation. Experiments demonstrate a significant improvement in our model compared to State of the Art (SOTA) on the Automatic Cardiac Diagnosis Challenge (ACDC) dataset and the Left Atrium (LA) dataset.
引用
收藏
页数:12
相关论文
共 49 条
[1]  
Arora Sanjeev., 2019, arXiv
[2]   Bidirectional Copy-Paste for Semi-Supervised Medical Image Segmentation [J].
Bai, Yunhao ;
Chen, Duowen ;
Li, Qingli ;
Shen, Wei ;
Wang, Yan .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :11514-11524
[3]   Pseudo-label Guided Contrastive Learning for Semi-supervised Medical Image Segmentation [J].
Basak, Hritam ;
Yin, Zhaozheng .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, :19786-19797
[4]   Deep Learning Techniques for Automatic MRI Cardiac Multi-Structures Segmentation and Diagnosis: Is the Problem Solved? [J].
Bernard, Olivier ;
Lalande, Alain ;
Zotti, Clement ;
Cervenansky, Frederick ;
Yang, Xin ;
Heng, Pheng-Ann ;
Cetin, Irem ;
Lekadir, Karim ;
Camara, Oscar ;
Gonzalez Ballester, Miguel Angel ;
Sanroma, Gerard ;
Napel, Sandy ;
Petersen, Steffen ;
Tziritas, Georgios ;
Grinias, Elias ;
Khened, Mahendra ;
Kollerathu, Varghese Alex ;
Krishnamurthi, Ganapathy ;
Rohe, Marc-Michel ;
Pennec, Xavier ;
Sermesant, Maxime ;
Isensee, Fabian ;
Jaeger, Paul ;
Maier-Hein, Klaus H. ;
Full, Peter M. ;
Wolf, Ivo ;
Engelhardt, Sandy ;
Baumgartner, Christian F. ;
Koch, Lisa M. ;
Wolterink, Jelmer M. ;
Isgum, Ivana ;
Jang, Yeonggul ;
Hong, Yoonmi ;
Patravali, Jay ;
Jain, Shubham ;
Humbert, Olivier ;
Jodoin, Pierre-Marc .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (11) :2514-2525
[5]   Local contrastive loss with pseudo-label based self-training for semi-supervised medical image segmentation [J].
Chaitanya, Krishna ;
Erdil, Ertunc ;
Karani, Neerav ;
Konukoglu, Ender .
MEDICAL IMAGE ANALYSIS, 2023, 87
[6]   Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision [J].
Chen, Xiaokang ;
Yuan, Yuhui ;
Zeng, Gang ;
Wang, Jingdong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2613-2622
[7]   Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images [J].
Fan, Deng-Ping ;
Zhou, Tao ;
Ji, Ge-Peng ;
Zhou, Yi ;
Chen, Geng ;
Fu, Huazhu ;
Shen, Jianbing ;
Shao, Ling .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) :2626-2637
[8]  
French G, 2020, Arxiv, DOI [arXiv:1906.01916, DOI 10.48550/ARXIV.1906.01916]
[9]  
Grandvalet Y., 2004, P NIPS
[10]   Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges [J].
Hesamian, Mohammad Hesam ;
Jia, Wenjing ;
He, Xiangjian ;
Kennedy, Paul .
JOURNAL OF DIGITAL IMAGING, 2019, 32 (04) :582-596