Semi-Supervised Pixel Contrastive Learning Framework for Tissue Segmentation in Histopathological Image

被引:17
作者
Shi, Jiangbo [1 ]
Gong, Tieliang [2 ]
Wang, Chunbao [3 ]
Li, Chen [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Natl Engn Lab Big Data Analyt, Xian 710049, Peoples R China
[2] Xi An Jiao Tong Univ, Sch Comp Sci & Technol, Key Lab Intelligent Networks & Network Secur, Minist Educ, Xian 710049, Peoples R China
[3] Xi An Jiao Tong Univ, Dept Pathol, Xian 710061, Peoples R China
基金
中国国家自然科学基金;
关键词
Image segmentation; Semantics; Pathology; Training; Task analysis; Data models; Adaptation models; Pathological image analysis; semi-supervised learning; contrastive learning; TUMOR MICROENVIRONMENT;
D O I
10.1109/JBHI.2022.3216293
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Accurate tissue segmentation in histopathological images is essential for promoting the development of precision pathology. However, the size of the digital pathological image is great, which needs to be tiled into small patches containing limited semantic information. To imitate the pathologist's diagnosis process and model the semantic relation of the whole slide image, We propose a semi-supervised pixel contrastive learning framework (SSPCL) which mainly includes an uncertainty-guided mutual dual consistency learning module (UMDC) and a cross image pixel-contrastive learning module (CIPC). The UMDC module enables efficient learning from unlabeled data through mutual dual-consistency and consensus-based uncertainty. The CIPC module aims at capturing the cross-patch semantic relationship by optimizing a contrastive loss between pixel embeddings. We also propose several novel domain-related sampling methods by utilizing the continuous spatial structure of adjacent image patches, which can avoid the problem of false sampling and improve the training efficiency. In this way, SSPCL significantly reduces the labeling cost on histopathological images and realizes the accurate quantitation of tissues. Extensive experiments on three tissue segmentation datasets demonstrate the effectiveness of SSPCL, which outperforms state-of-the-art up to 5.0% in mDice.
引用
收藏
页码:97 / 108
页数:12
相关论文
共 61 条
[1]   Structured crowdsourcing enables convolutional segmentation of histology images [J].
Amgad, Mohamed ;
Elfandy, Habiba ;
Hussein, Hagar ;
Atteya, Lamees A. ;
Elsebaie, Mai A. T. ;
Elnasr, Lamia S. Abo ;
Sakr, Rokia A. ;
Salem, Hazem S. E. ;
Ismail, Ahmed F. ;
Saad, Anas M. ;
Ahmed, Joumana ;
Elsebaie, Maha A. T. ;
Rahman, Mustafijur ;
Ruhban, Inas A. ;
Elgazar, Nada M. ;
Alagha, Yahya ;
Osman, Mohamed H. ;
Alhusseiny, Ahmed M. ;
Khalaf, Mariam M. ;
Younes, Abo-Alela F. ;
Abdulkarim, Ali ;
Younes, Duaa M. ;
Gadallah, Ahmed M. ;
Elkashash, Ahmad M. ;
Fala, Salma Y. ;
Zaki, Basma M. ;
Beezley, Jonathan ;
Chittajallu, Deepak R. ;
Manthey, David ;
Gutman, David A. ;
Cooper, Lee A. D. .
BIOINFORMATICS, 2019, 35 (18) :3461-3467
[2]  
Berthelot D, 2019, ADV NEUR IN, V32
[3]  
Chaitanya K., ADV NEURAL INF PROCE, V33, P12546
[4]   DCAN: Deep Contour-Aware Networks for Accurate Gland Segmentation [J].
Chen, Hao ;
Qi, Xiaojuan ;
Yu, Lequan ;
Heng, Pheng-Ann .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2487-2496
[5]  
Chen LC, 2017, Arxiv, DOI arXiv:1706.05587
[6]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[7]  
Chen Ting, 2019, 25 AMERICAS C INFORM
[8]   Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision [J].
Chen, Xiaokang ;
Yuan, Yuhui ;
Zeng, Gang ;
Wang, Jingdong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2613-2622
[9]   Exploring Simple Siamese Representation Learning [J].
Chen, Xinlei ;
He, Kaiming .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15745-15753
[10]   MEASURES OF THE AMOUNT OF ECOLOGIC ASSOCIATION BETWEEN SPECIES [J].
DICE, LR .
ECOLOGY, 1945, 26 (03) :297-302