A robust transductive distribution calibration method for few-shot learning

被引:0
|
作者
Li, Jingcong [1 ]
Ye, Chunjin [1 ]
Wang, Fei [1 ]
Pan, Jiahui [1 ]
机构
[1] South China Normal Univ, Sch Artificial Intelligence, Foshan 528200, Peoples R China
关键词
Few-shot learning; Transductive learning; Distribution estimation;
D O I
10.1016/j.patcog.2025.111488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) has gained much attention and has recently made substantial progress. To alleviate the data constraints in FSL, previous studies have attempted to generate features by learning a feature distribution. However, the learned distribution is biased and unstable due to limited labeled data, and the features from it can be even more biased, which decreases its generalizability. This paper proposes a Robust Transductive Distribution Calibration (RTDC) method to estimate feature distributions of few-shot classes in a more accurate and robust way. First, we capture the underlying distribution information by precisely estimating the covariance matrix of each novel category. Second, we consider the distribution similarity between labeled and unlabeled samples using the estimated covariance matrix and then optimize the feature distribution in a transductive manner. Extensive experiments demonstrated the effectiveness and significance of our method on several FSL benchmarks, including miniImageNet, tieredImageNet, CUB, and CIFAR-FS.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Transductive distribution calibration for few-shot learning
    Li, Gang
    Zheng, Changwen
    Su, Bing
    Neurocomputing, 2022, 500 : 604 - 615
  • [2] Transductive distribution calibration for few-shot learning
    Li, Gang
    Zheng, Changwen
    Su, Bing
    NEUROCOMPUTING, 2022, 500 : 604 - 615
  • [3] A transductive learning method to leverage graph structure for few-shot learning
    Wang, Yaning
    Liu, Zijian
    Luo, Yang
    Luo, Chunbo
    PATTERN RECOGNITION LETTERS, 2022, 159 : 189 - 195
  • [4] Transductive Information Maximization For Few-Shot Learning
    Boudiaf, Malik
    Masud, Ziko Imtiaz
    Rony, Jerome
    Dolz, Jose
    Piantanida, Pablo
    Ben Ayed, Ismail
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [5] Realistic Evaluation of Transductive Few-Shot Learning
    Veilleux, Olivier
    Boudiaf, Malik
    Piantanida, Pablo
    Ben Ayed, Ismail
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [6] Task Encoding With Distribution Calibration for Few-Shot Learning
    Zhang, Jing
    Zhang, Xinzhou
    Wang, Zhe
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 6240 - 6252
  • [7] SSL-DC: Improving Transductive Few-Shot Learning via Self-Supervised Learning and Distribution Calibration
    Yang, Huayi
    Wang, Deqing
    Zhao, Zhengyang
    Wang, Xuying
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 4892 - 4898
  • [8] Capturing the few-shot class distribution: Transductive distribution optimization
    Liu, Xinyue
    Liu, Ligang
    Liu, Han
    Zhang, Xiaotong
    PATTERN RECOGNITION, 2023, 138
  • [9] Feature Transductive Distribution Optimization for Few-Shot Image Classification
    Liu, Qing
    Tang, Xianlun
    Wang, Ying
    Li, Xingchen
    Jiang, Xinyan
    Li, Weisheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (03) : 2230 - 2243
  • [10] EASE: Unsupervised Discriminant Subspace Learning for Transductive Few-Shot Learning
    Zhu, Hao
    Koniusz, Piotr
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 9068 - 9078