Toward Better Generalization of Cross-Domain Few-Shot Classification in Tibetan Character With Contrastive Learning and Meta Fine-Tuning

被引:0
|
作者
Bao, Xun [1 ]
Wang, Weilan [1 ,2 ]
Wang, Xiaojuan [1 ,2 ]
Zhao, Guanzhong [1 ]
Li, Huarui [1 ]
Liu, Meiling [1 ]
机构
[1] Northwest Minzu Univ, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Peoples R China
[2] Northwest Minzu Univ, Sch Math & Comp Sci, Lanzhou 730030, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Training; Contrastive learning; Data augmentation; Text recognition; Data models; Few shot learning; Feature extraction; Transfer learning; Cross-domain few-shot learning; contrastive learning; meta learning; transfer learning;
D O I
10.1109/ACCESS.2024.3459933
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot classification aims to classify unseen classes (query instances) with few labeled samples from each class (support instances). However, current few-shot learning methods assume that the training and testing sets obey the same distribution. When there exists a huge domain gap between the training and testing sets, they fail to generalize well across domains. In this work, we tackle the cross-domain few-shot learning (CD-FSL) problem in Tibetan characters from two perspectives. In the meta-training phase, we seamlessly introduce contrastive learning into the episodic training paradigm and apply a data augmentation strategy to seek better feature representations thereby improving the ability to recognize unseen categories. In the meta-finetuning phase, we then integrate the above algorithm into transfer learning and propose a fine-tuning method that generates episodic synthetic query sets to enhance generalization capability across domains. These two stages force the model to overcome the domain shift between training and testing sets. Extensive experiments show that our simple approach allows us to establish competitive results on the well-known few-shot learning dataset Omniglot and state-of-the-art results on our Tibetan character datasets. The code will be publicly available in this repository: https://github.com/coder-bossin/fs-TCR.
引用
收藏
页码:134439 / 134452
页数:14
相关论文
共 50 条
  • [1] Cross-Domain Few-Shot Contrastive Learning for Hyperspectral Images Classification
    Zhang, Suhua
    Chen, Zhikui
    Wang, Dan
    Wang, Z. Jane
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] ReFine: Re-randomization before Fine-tuning for Cross-domain Few-shot Learning
    Oh, Jaehoon
    Kim, Sungnyun
    Ho, Namgyu
    Kim, Jin-Hwa
    Song, Hwanjun
    Yun, Se-Young
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2022, 2022, : 4359 - 4363
  • [3] Deep Cross-Domain Few-Shot Learning for Hyperspectral Image Classification
    Li, Zhaokui
    Liu, Ming
    Chen, Yushi
    Xu, Yimin
    Li, Wei
    Du, Qian
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Experiments in cross-domain few-shot learning for image classification
    Wang, Hongyu
    Gouk, Henry
    Fraser, Huon
    Frank, Eibe
    Pfahringer, Bernhard
    Mayo, Michael
    Holmes, Geoffrey
    JOURNAL OF THE ROYAL SOCIETY OF NEW ZEALAND, 2023, 53 (01) : 169 - 191
  • [5] Dual-Task Contrastive Meta-Learning for Few-Shot Cross-Domain Emotion Recognition
    Tang, Yujiao
    Wu, Yadong
    He, Yuanmei
    Liu, Jilin
    Zhang, Weihan
    CMC-COMPUTERS MATERIALS & CONTINUA, 2025, 82 (02): : 2331 - 2352
  • [6] Cross-Domain Meta-Learning Under Dual-Adjustment Mode for Few-Shot Hyperspectral Image Classification
    Hu, Lei
    He, Wei
    Zhang, Liangpei
    Zhang, Hongyan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [7] Multilevel Prototype Alignment for Cross-Domain Few-Shot Hyperspectral Image Classification
    Liu, Hanchi
    He, Jinrong
    Li, Yuhang
    Bi, Yingzhou
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [8] Transformer-Based Cross-Domain Few-Shot Learning for Hyperspectral Target Detection
    Feng, Shou
    Wang, Xueqing
    Feng, Rui
    Xiong, Fengchao
    Zhao, Chunhui
    Li, Wei
    Tao, Ran
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [9] COFT-AD: COntrastive Fine-Tuning for Few-Shot Anomaly Detection
    Liao, Jingyi
    Xu, Xun
    Nguyen, Manh Cuong
    Goodge, Adam
    Foo, Chuan Sheng
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 2090 - 2103
  • [10] Domain Mapping Network for Remote Sensing Cross-Domain Few-Shot Classification
    Lu, Xiaoqiang
    Gong, Tengfei
    Zheng, Xiangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 11