Feature hallucination in hypersphere space for few-shot classification

被引:1
|
作者
Yang, Sai [1 ]
Liu, Fan [2 ]
Chen, Zhiyu [2 ]
机构
[1] Nantong Univ, Sch Elect Engn, Nantong, Jiangsu, Peoples R China
[2] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Jiangsu, Peoples R China
关键词
Nearest neighbor search;
D O I
10.1049/ipr2.12579
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot classification (FSC) targeting at classifying unseen classes with few labelled samples is still a challenging task. Recent works show that transfer-learning based approaches are competitive with meta-learning ones, which usually pre-train a convolutional neural networks (CNN)-based network using cross-entropy (CE) loss and throw away the last layer to post-process the novel classes. Hereby, they still suffer the issue of getting a more transferable extractor and lacking enough labelled novel samples. Thus, the authors propose the algorithm of feature hallucination in hypersphere space (FHHS) for FSC. On the first stage, the authors pre-train a more transferable feature extractor using a hypersphere loss (HL), which supplies CE with supervised contrastive (SC) loss and self-supervised loss (SSL), in which SC can map the base and novel images onto the hypersphere space densely. On the second stage, the authors generate new samples for unseen classes using their novel algorithm of synthetic novel sampling with the base (SNSB), which linearly interpolate between each novel class prototype and its K nearest neighbour base class prototypes. Comprehensive experiments on multiple popular FSC demonstrate that HL loss can enhance the performance of backbone network and the authors' feature hallucination method is superior to the existing hallucination-based methods.
引用
收藏
页码:3603 / 3616
页数:14
相关论文
共 50 条
  • [1] Joint Feature Disentanglement and Hallucination for Few-Shot Image Classification
    Lin, Chia-Ching
    Chu, Hsin-Li
    Wang, Yu-Chiang Frank
    Lei, Chin-Laung
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 9245 - 9258
  • [2] Label Hallucination for Few-Shot Classification
    Jian, Yiren
    Torresani, Lorenzo
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / THE TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 7005 - 7014
  • [3] Task-oriented feature hallucination for few-shot image classification
    Wu, Sining
    Gao, Xiang
    Hu, Xiaopeng
    IET IMAGE PROCESSING, 2023, 17 (12) : 3564 - 3579
  • [4] Few-shot Classification with Hypersphere Modeling of Prototypes
    Ding, Ning
    Chen, Yulin
    Cui, Ganqu
    Wang, Xiaobin
    Zheng, Hai-Tao
    Liu, Zhiyuan
    Xie, Pengjun
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL 2023, 2023, : 895 - 917
  • [5] Task-Adaptive Feature Disentanglement and Hallucination for Few-Shot Classification
    Hu, Zixuan
    Shen, Li
    Lai, Shenqi
    Yuan, Chun
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (08) : 3638 - 3648
  • [6] Tensor feature hallucination for few-shot learning
    Lazarou, Michalis
    Stathaki, Tania
    Avrithis, Yannis
    2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, : 2050 - 2060
  • [7] Class feature Sub-space for few-shot classification
    Song, Bin
    Zhu, Hong
    Wang, Bingxin
    Bi, Yuandong
    APPLIED INTELLIGENCE, 2024, 54 (19) : 9177 - 9194
  • [8] Feature hallucination via Maximum A Posteriori for few-shot learning
    Wu, Jiaying
    Dong, Ning
    Liu, Fan
    Yang, Sai
    Hu, Jinglu
    KNOWLEDGE-BASED SYSTEMS, 2021, 225
  • [9] Few-Shot Learning via Feature Hallucination with Variational Inference
    Luo, Qinxuan
    Wang, Lingfeng
    Lv, Jingguo
    Xiang, Shiming
    Pan, Chunhong
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 3962 - 3971
  • [10] Few-Shot Classification With Feature Reconstruction Bias
    Li, Zhen
    Wang, Lang
    Ding, Shuo
    Yang, Xiaochen
    Li, Xiaoxu
    PROCEEDINGS OF 2022 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC), 2022, : 526 - 532