Pseudo-loss Confidence Metric for Semi-supervised Few-shot Learning

被引:52
作者
Huang, Kai [1 ]
Geng, Jie [1 ]
Jiang, Wen [1 ]
Deng, Xinyang [1 ]
Xu, Zhe [1 ]
机构
[1] Northwestern Polytech Univ, Xian, Peoples R China
来源
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) | 2021年
基金
中国国家自然科学基金;
关键词
D O I
10.1109/ICCV48922.2021.00855
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised few-shot learning is developed to train a classifier that can adapt to new tasks with limited labeled data and a fixed quantity of unlabeled data. Most semi-supervised few-shot learning methods select pseudo-labeled data of unlabeled set by task-specific confidence estimation. This work presents a task-unified confidence estimation approach for semi-supervised few-shot learning, named pseudo-loss confidence metric (PLCM). It measures the data credibility by the loss distribution of pseudo-labels, which is synthetical considered multi-tasks. Specifically, pseudo-labeled data of different tasks are mapped to a unified metric space by mean of the pseudo-loss model, making it possible to learn the prior pseudo-loss distribution. Then, confidence of pseudo-labeled data is estimated according to the distribution component confidence of its pseudo-loss. Thus highly reliable pseudo-labeled data are selected to strengthen the classifier. Moreover, to overcome the pseudo-loss distribution shift and improve the effectiveness of classifier, we advance the multi-step training strategy coordinated with the class balance measures of class-apart selection and class weight. Experimental results on four popular benchmark datasets demonstrate that the proposed approach can effectively select pseudo-labeled data and achieve the state-of-the-art performance.
引用
收藏
页码:8651 / 8660
页数:10
相关论文
共 45 条
[31]  
Rusu A.A., 2019, INT C LEARNING REPRE
[32]  
Snell J, 2017, ADV NEUR IN, V30
[33]  
Sohn Kihyuk, 2020, Advances in neural information processing systems
[34]  
Srivastava N, 2014, J MACH LEARN RES, V15, P1929
[35]   Revisiting Unreasonable Effectiveness of Data in Deep Learning Era [J].
Sun, Chen ;
Shrivastava, Abhinav ;
Singh, Saurabh ;
Gupta, Abhinav .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :843-852
[36]  
Sun LX, 2020, FASCINAT LIFE SCI, P3, DOI 10.1007/978-3-030-27920-2_1
[37]   Meta-Transfer Learning for Few-Shot Learning [J].
Sun, Qianru ;
Liu, Yaoyao ;
Chua, Tat-Seng ;
Schiele, Bernt .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :403-412
[38]   Learning to Compare: Relation Network for Few-Shot Learning [J].
Sung, Flood ;
Yang, Yongxin ;
Zhang, Li ;
Xiang, Tao ;
Torr, Philip H. S. ;
Hospedales, Timothy M. .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1199-1208
[39]  
Tarvainen A, 2017, ADV NEUR IN, V30
[40]  
Vinyals O., 2016, ADV NEURAL INFORM PR, V29