A robust transductive distribution calibration method for few-shot learning

被引:0
|
作者
Li, Jingcong [1 ]
Ye, Chunjin [1 ]
Wang, Fei [1 ]
Pan, Jiahui [1 ]
机构
[1] South China Normal Univ, Sch Artificial Intelligence, Foshan 528200, Peoples R China
关键词
Few-shot learning; Transductive learning; Distribution estimation;
D O I
10.1016/j.patcog.2025.111488
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot learning (FSL) has gained much attention and has recently made substantial progress. To alleviate the data constraints in FSL, previous studies have attempted to generate features by learning a feature distribution. However, the learned distribution is biased and unstable due to limited labeled data, and the features from it can be even more biased, which decreases its generalizability. This paper proposes a Robust Transductive Distribution Calibration (RTDC) method to estimate feature distributions of few-shot classes in a more accurate and robust way. First, we capture the underlying distribution information by precisely estimating the covariance matrix of each novel category. Second, we consider the distribution similarity between labeled and unlabeled samples using the estimated covariance matrix and then optimize the feature distribution in a transductive manner. Extensive experiments demonstrated the effectiveness and significance of our method on several FSL benchmarks, including miniImageNet, tieredImageNet, CUB, and CIFAR-FS.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Adaptive multi-scale transductive information propagation for few-shot learning
    Fu, Sichao
    Liu, Baodi
    Liu, Weifeng
    Zou, Bin
    You, Xinhua
    Peng, Qinmu
    Jing, Xiao-Yuan
    KNOWLEDGE-BASED SYSTEMS, 2022, 249
  • [42] FedFM: A federated few-shot learning method by comparison network and model calibration
    Zhao, Chen
    Bao, Shudi
    Chen, Meng
    Gao, Zhipeng
    Xiao, Kaile
    Dai, Peng
    KNOWLEDGE-BASED SYSTEMS, 2025, 309
  • [43] ECKPN: Explicit Class Knowledge Propagation Network for Transductive Few-shot Learning
    Chen, Chaofan
    Yang, Xiaoshan
    Xu, Changsheng
    Huang, Xuhui
    Ma, Zhe
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 6592 - 6601
  • [44] Learning to Capture the Query Distribution for Few-Shot Learning
    Chi, Ziqiu
    Wang, Zhe
    Yang, Mengping
    Li, Dongdong
    Du, Wenli
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) : 4163 - 4173
  • [45] Asymmetric Distribution Measure for Few-shot Learning
    Li, Wenbin
    Wang, Lei
    Huo, Jing
    Shi, Yinghuan
    Gao, Yang
    Luo, Jiebo
    PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2020, : 2957 - 2963
  • [46] Few-Shot Few-Shot Learning and the role of Spatial Attention
    Lifchitz, Yann
    Avrithis, Yannis
    Picard, Sylvaine
    2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, : 2693 - 2700
  • [47] A unified transductive and inductive learning framework for Few-Shot Learning using Graph Neural Networks
    Chang, Jie
    Ren, Haodong
    Li, Zuoyong
    Xu, Yinlong
    Lai, Taotao
    APPLIED SOFT COMPUTING, 2025, 173
  • [48] A Variational Inference Method for Few-Shot Learning
    Xu, Jian
    Liu, Bo
    Xiao, Yanshan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) : 269 - 282
  • [49] Learning to Extrapolate Knowledge: Transductive Few-shot Out-of-Graph Link Prediction
    Baek, Jinheon
    Lee, Dong Bok
    Hwang, Sung Ju
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [50] Few-Shot Malware Classification via Attention-Based Transductive Learning Network
    Deng, Liting
    Yu, Chengli
    Wen, Hui
    Xin, Mingfeng
    Sun, Yue
    Sun, Limin
    Zhu, Hongsong
    MOBILE NETWORKS & APPLICATIONS, 2024, : 1690 - 1704