Class Probability Space Regularization for semi-supervised semantic segmentation

被引:4
作者
Yin, Jianjian [1 ]
Yan, Shuai [2 ]
Chen, Tao [2 ]
Chen, Yi [1 ]
Yao, Yazhou [2 ]
机构
[1] Nanjing Normal Univ, Sch Comp & Elect Informat Artificial Intelligence, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Jiangsu, Peoples R China
基金
中国博士后科学基金;
关键词
Human visual attention mechanisms; Semi-supervised semantic segmentation; Class probability space regularization; Class knowledge reshaping; Tail probability suppression;
D O I
10.1016/j.cviu.2024.104146
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semantic segmentation achieves fine-grained scene parsing in any scenario, making it one of the key research directions to facilitate the development of human visual attention mechanisms. Recent advancements in semi- supervised semantic segmentation have attracted considerable attention due to their potential in leveraging unlabeled data. However, existing methods only focus on exploring the knowledge of unlabeled pixels with high certainty prediction. Their insufficient mining of low certainty regions of unlabeled data results in a significant loss of supervisory information. Therefore, this paper proposes the Class Probability Space Regularization ( CPSR ) approach to further exploit the potential of each unlabeled pixel. Specifically, we first design a class knowledge reshaping module to regularize the probability space of low certainty pixels, thereby transforming them into high certainty ones for supervised training. Furthermore, we propose a tail probability suppression module to suppress the probabilities of tailed classes, which facilitates the network to learn more discriminative information from the class probability space. Extensive experiments conducted on the PASCAL VOC2012 and Cityscapes datasets prove that our method achieves state-of-the-art performance without introducing much computational overhead.
引用
收藏
页数:10
相关论文
共 82 条
[1]   Poly Kernel Inception Network for Remote Sensing Detection [J].
Cai, Xinhao ;
Lai, Qiuxia ;
Wang, Yuwei ;
Wang, Wenguan ;
Sun, Zeren ;
Yao, Yazhou .
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, :27706-27716
[2]   Human Vision Attention Mechanism-Inspired Temporal-Spatial Feature Pyramid for Video Saliency Detection [J].
Chang, Qinyao ;
Zhu, Shiping .
COGNITIVE COMPUTATION, 2023, 15 (03) :856-868
[3]   Generative Semantic Segmentation [J].
Chen, Jiaqi ;
Lu, Jiachen ;
Zhu, Xiatian ;
Zhang, Li .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :7111-7120
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   Spatial Structure Constraints for Weakly Supervised Semantic Segmentation [J].
Chen, Tao ;
Yao, Yazhou ;
Huang, Xingguo ;
Li, Zechao ;
Nie, Liqiang ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 :1136-1148
[6]   Multi-Granularity Denoising and Bidirectional Alignment for Weakly Supervised Semantic Segmentation [J].
Chen, Tao ;
Yao, Yazhou ;
Tang, Jinhui .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :2960-2971
[7]   Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision [J].
Chen, Xiaokang ;
Yuan, Yuhui ;
Zeng, Gang ;
Wang, Jingdong .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :2613-2622
[8]   LEARNING MULTISCALE CONSISTENCY FOR SELF-SUPERVISED ELECTRON MICROSCOPY INSTANCE SEGMENTATION [J].
Chen, Yinda ;
Huang, Wei ;
Liu, Xiaoyu ;
Deng, Shiyu ;
Chen, Qi ;
Xiong, Zhiwei .
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, :1566-1570
[9]  
Chen YD, 2024, Arxiv, DOI arXiv:2405.16847
[10]  
Chen YD, 2023, PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, P609