Self-supervised Network Evolution for Few-shot Classification

被引:0
|
作者
Tang, Xuwen [1 ]
Teng, Zhu [1 ]
Zhang, Baopeng [1 ]
Fan, Jianping [2 ]
机构
[1] Beijing Jiaotong Univ, Beijing, Peoples R China
[2] Lenovo Res, Res Triangle Pk, NC USA
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot classification aims to recognize new classes by learning reliable models from very few available samples. It could be very challenging when there is no intersection between the already-known classes (base set) and the novel set (new classes). To alleviate this problem, we propose to evolve the network (for the base set) via label propagation and self-supervision to shrink the distribution difference between the base set and the novel set. Our network evolution approach transfers the latent distribution from the already-known classes to the unknown (novel) classes by: (a) label propagation of the novel/new classes (novel set); and (b) design of dual-task to exploit a discriminative representation to effectively diminish the overfitting on the base set and enhance the generalization ability on the novel set. We conduct comprehensive experiments to examine our network evolution approach against numerous state-of-the-art ones, especially in a higher way setup and cross-dataset scenarios. Notably, our approach outperforms the second best state-of-the-art method by a large margin of 3.25% for one-shot evaluation over miniImageNet.
引用
收藏
页码:3045 / 3051
页数:7
相关论文
共 50 条
  • [21] A Survey of Self-Supervised and Few-Shot Object Detection
    Huang, Gabriel
    Laradji, Issam
    Vazquez, David
    Lacoste-Julien, Simon
    Rodriguez, Pau
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (04) : 4071 - 4089
  • [22] Distilling Self-Supervised Vision Transformers for Weakly-Supervised Few-Shot Classification & Segmentation
    Kang, Dahyun
    Koniusz, Piotr
    Cho, Minsu
    Murray, Naila
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 19627 - 19638
  • [23] Few-shot object detection based on self-supervised feature pyramid network
    Lv, Wen
    Qi, Xinwei
    Shi, Hongbo
    Tan, Shuai
    Song, Bing
    Tao, Yang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)
  • [24] Few-shot image classification with composite rotation based self-supervised auxiliary task
    Mazumder, Pratik
    Singh, Pravendra
    Namboodiri, Vinay P.
    NEUROCOMPUTING, 2022, 489 : 179 - 195
  • [25] Few-Shot Open-Set Traffic Classification Based on Self-Supervised Learning
    Li, Ji
    Gu, Chunxiang
    Luan, Luan
    Wei, Fushan
    Liu, Wenfen
    PROCEEDINGS OF THE 2022 47TH IEEE CONFERENCE ON LOCAL COMPUTER NETWORKS (LCN 2022), 2022, : 371 - 374
  • [26] Collaborative Self-Supervised Transductive Few-Shot Learning for Remote Sensing Scene Classification
    Han, Haiyan
    Huang, Yangchao
    Wang, Zhe
    ELECTRONICS, 2023, 12 (18)
  • [27] Self-Supervised Meta-Learning for Few-Shot Natural Language Classification Tasks
    Bansal, Trapit
    Jha, Rishikesh
    Munkhdalai, Tsendsuren
    McCallum, Andrew
    PROCEEDINGS OF THE 2020 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING (EMNLP), 2020, : 522 - 534
  • [28] Multiform Ensemble Self-Supervised Learning for Few-Shot Remote Sensing Scene Classification
    Li, Jianzhao
    Gong, Maoguo
    Liu, Huilin
    Zhang, Yourun
    Zhang, Mingyang
    Wu, Yue
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [29] CSN: Component supervised network for few-shot classification
    Xu, Rui
    Shao, Shuai
    Xing, Lei
    Wei, Yujun
    Liu, Weifeng
    Liu, Baodi
    Wang, Yanjiang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 124
  • [30] Self-Supervised Learning for Few-Shot Medical Image Segmentation
    Ouyang, Cheng
    Biffi, Carlo
    Chen, Chen
    Kart, Turkay
    Qiu, Huaqi
    Rueckert, Daniel
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (07) : 1837 - 1848