Learning task-specific discriminative embeddings for few-shot image classification

被引:19
|
作者
Xing, Lei [1 ]
Shao, Shuai [2 ]
Liu, Weifeng [2 ]
Han, Anxun [1 ]
Pan, Xiangshuai [1 ]
Liu, Bao-Di [2 ]
机构
[1] China Univ Petr, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
[2] China Univ Petr, Coll Control Sci & Engn, Qingdao 266580, Peoples R China
关键词
Few-shot learning; Dictionary learning; Task-specific discriminative embeddings;
D O I
10.1016/j.neucom.2022.02.073
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, few-shot learning has attracted more and more attention. Generally, the fine-tuning-based few shot learning framework contains two stages: i) In the pre-training stage, using base data to train the feature extractor; ii) In the meta-testing stage, using a well-trained feature extractor to extract embedding features of novel data and designing a base learner to predict the labels. Due to the diverse categories of base and novel data, it is challenging for the feature extractor trained in the pre-training stage to adapt to novel data, which will result in an embedding-mismatch problem. This paper proposes Task-specific Discriminative Embeddings for Few-shot Learning (TDE-FSL) to solve the embedding-mismatch problem. Specifically, we embed the dictionary learning method into the few-shot learning framework to map the feature embeddings to a more discriminative subspace to adapt to the specific task. Moreover, we extend the self-training framework to our approach to fully utilize the unlabeled data. Finally, we evaluate the TDE-FSL on five benchmark image datasets, such as mini-Imagenet, tiered-Imagenet, CIFAR-FS, FC100, and CUB dataset. The experimental results show that the performance of our proposed TDE-FSL achieves a significant improvement.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:1 / 13
页数:13
相关论文
共 50 条
  • [41] Few-shot class-incremental audio classification via discriminative prototype learning
    Xie, Wei
    Li, Yanxiong
    He, Qianhua
    Cao, Wenchang
    EXPERT SYSTEMS WITH APPLICATIONS, 2023, 225
  • [43] Task-Adaptive Few-shot Node Classification
    Wang, Song
    Ding, Kaize
    Zhang, Chuxu
    Chen, Chen
    Li, Jundong
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 1910 - 1919
  • [44] Few-shot classification in Named Entity Recognition Task
    Fritzler, Alexander
    Logacheva, Varvara
    Kretov, Maksim
    SAC '19: PROCEEDINGS OF THE 34TH ACM/SIGAPP SYMPOSIUM ON APPLIED COMPUTING, 2019, : 993 - 1000
  • [45] Learning to Class-Adaptively Manipulate Embeddings for Few-Shot Learning
    Zhou, Fei
    Wei, Wei
    Zhang, Lei
    Zhang, Yanning
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (09) : 5062 - 5075
  • [46] Learning Primitive-Aware Discriminative Representations for Few-Shot Learning
    Yang, Jianpeng
    Niu, Yuhang
    Xie, Xuemei
    Shi, Guangming
    NEURAL INFORMATION PROCESSING, ICONIP 2023, PT II, 2024, 14448 : 131 - 146
  • [47] Aligning Visual Prototypes with BERT Embeddings for Few-Shot Learning
    Yan, Kun
    Bouraoui, Zied
    Wang, Ping
    Jameel, Shoaib
    Schockaert, Steven
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 367 - 375
  • [48] Few-shot learning for short text classification
    Leiming Yan
    Yuhui Zheng
    Jie Cao
    Multimedia Tools and Applications, 2018, 77 : 29799 - 29810
  • [49] Diversified Contrastive Learning For Few-Shot Classification
    Lu, Guangtong
    Li, Fanzhang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 147 - 158
  • [50] Visual Classification of Malware by Few-shot Learning
    Tran, Kien
    Kubo, Masao
    Sato, Hiroshi
    PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON ARTIFICIAL LIFE AND ROBOTICS (ICAROB2020), 2020, : 770 - 774