Conservative-Progressive Collaborative Learning for Semi-Supervised Semantic Segmentation

被引:2
作者
Fan S. [1 ,2 ]
Zhu F. [1 ]
Feng Z. [3 ]
Lv Y. [1 ]
Song M. [3 ]
Wang F.-Y. [1 ]
机构
[1] Institute of Automation, State Key Laboratory of Management and Control of Complex Systems, Chinese Academy of Sciences, Beijing
[2] Institute for AI Industry Research (AIR), Tsinghua University, Beijing
[3] Zhejiang University, College of Computer Science and Technology, Hangzhou
关键词
pseudo supervision; Semantic segmentation; semi-supervised learning;
D O I
10.1109/TIP.2023.3242819
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Pseudo supervision is regarded as the core idea in semi-supervised learning for semantic segmentation, and there is always a tradeoff between utilizing only the high-quality pseudo labels and leveraging all the pseudo labels. Addressing that, we propose a novel learning approach, called Conservative-Progressive Collaborative Learning (CPCL), among which two predictive networks are trained in parallel, and the pseudo supervision is implemented based on both the agreement and disagreement of the two predictions. One network seeks common ground via intersection supervision and is supervised by the high-quality labels to ensure a more reliable supervision, while the other network reserves differences via union supervision and is supervised by all the pseudo labels to keep exploring with curiosity. Thus, the collaboration of conservative evolution and progressive exploration can be achieved. To reduce the influences of the suspicious pseudo labels, the loss is dynamic re-weighted according to the prediction confidence. Extensive experiments demonstrate that CPCL achieves state-of-the-art performance for semi-supervised semantic segmentation. © 1992-2012 IEEE.
引用
收藏
页码:6183 / 6194
页数:11
相关论文
共 44 条
[1]  
Zhu F., Lv Y., Chen Y., Wang X., Wang F., Parallel transportation systems: Toward IoT-enabled smart urban traffic control and management, IEEE Trans. Intell. Transp. Syst., 21, 10, pp. 4063-4071, (2020)
[2]  
Cordts M., Et al., The cityscapes dataset for semantic urban scene understanding, Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun., pp. 3213-3223, (2016)
[3]  
Lin T.-Y., Et al., Microsoft COCO: Common objects in context, Proc. Eur. Conf. Comput. Vis., pp. 740-755, (2014)
[4]  
Grandvalet Y., Bengio Y., Semi-supervised learning by entropy minimization, Proc. Adv. Neural Inf. Process. Syst., pp. 529-536, (2005)
[5]  
Hung W.-C., Tsai Y.-H., Liou Y.-T., Lin Y.-Y., Yang M.-H., Adversarial Learning for Semi-supervised Semantic Segmentation, (2018)
[6]  
Tarvainen A., Valpola H., Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results, Proc. Adv. Neural Inf. Process. Syst., pp. 1196-1205, (2017)
[7]  
Miyato T., Maeda S.-I., Koyama M., Ishii S., Virtual adversarial training: A regularization method for supervised and semi-supervised learning, IEEE Trans. Pattern Anal. Mach. Intell., 41, 8, pp. 1979-1993, (2019)
[8]  
Wang X., Kihara D., Luo J., Qi G.-J., EnAET: A self-trained framework for semi-supervised and supervised learning with ensemble transformations, IEEE Trans. Image Process., 30, pp. 1639-1647, (2021)
[9]  
French G., Laine S., Aila T., Mackiewicz M., Finlayson G., Semisupervised Semantic Segmentation Needs Strong, Varied Perturbations, (2019)
[10]  
Ouali Y., Hudelot C., Tami M., Semi-supervised semantic segmentation with cross-consistency training, Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 12671-12681, (2020)