Toward Better Generalization of Cross-Domain Few-Shot Classification in Tibetan Character With Contrastive Learning and Meta Fine-Tuning

被引:0
作者
Bao, Xun [1 ]
Wang, Weilan [1 ,2 ]
Wang, Xiaojuan [1 ,2 ]
Zhao, Guanzhong [1 ]
Li, Huarui [1 ]
Liu, Meiling [1 ]
机构
[1] Northwest Minzu Univ, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Peoples R China
[2] Northwest Minzu Univ, Sch Math & Comp Sci, Lanzhou 730030, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
基金
中国国家自然科学基金;
关键词
Training; Contrastive learning; Data augmentation; Text recognition; Data models; Few shot learning; Feature extraction; Transfer learning; Cross-domain few-shot learning; contrastive learning; meta learning; transfer learning;
D O I
10.1109/ACCESS.2024.3459933
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot classification aims to classify unseen classes (query instances) with few labeled samples from each class (support instances). However, current few-shot learning methods assume that the training and testing sets obey the same distribution. When there exists a huge domain gap between the training and testing sets, they fail to generalize well across domains. In this work, we tackle the cross-domain few-shot learning (CD-FSL) problem in Tibetan characters from two perspectives. In the meta-training phase, we seamlessly introduce contrastive learning into the episodic training paradigm and apply a data augmentation strategy to seek better feature representations thereby improving the ability to recognize unseen categories. In the meta-finetuning phase, we then integrate the above algorithm into transfer learning and propose a fine-tuning method that generates episodic synthetic query sets to enhance generalization capability across domains. These two stages force the model to overcome the domain shift between training and testing sets. Extensive experiments show that our simple approach allows us to establish competitive results on the well-known few-shot learning dataset Omniglot and state-of-the-art results on our Tibetan character datasets. The code will be publicly available in this repository: https://github.com/coder-bossin/fs-TCR.
引用
收藏
页码:134439 / 134452
页数:14
相关论文
共 50 条
  • [21] Few-Shot MS and PAN Joint Classification With Improved Cross-Source Contrastive Learning
    Zhu, Hao
    Guo, Pute
    Hou, Biao
    Li, Xiaotong
    Jiao, Changzhe
    Ren, Bo
    Jiao, Licheng
    Wang, Shuang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [22] Few-Shot Learning With Prototype Rectification for Cross-Domain Hyperspectral Image Classification
    Qin, Anyong
    Yuan, Chaoqi
    Li, Qiang
    Luo, Xiaoliu
    Yang, Feng
    Song, Tiecheng
    Gao, Chenqiang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [23] An Adversarial Meta-Training Framework for Cross-Domain Few-Shot Learning
    Tian, Pinzhuo
    Xie, Shaorong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 6881 - 6891
  • [24] Meta-collaborative comparison for effective cross-domain few-shot learning
    Zhou, Fei
    Wang, Peng
    Zhang, Lei
    Wei, Wei
    Zhang, Yanning
    PATTERN RECOGNITION, 2024, 156
  • [25] Convert Cross-Domain Classification Into Few-Shot Learning: A Unified Prompt-Tuning Framework for Unsupervised Domain Adaptation
    Zhu, Yi
    Shen, Hui
    Li, Yun
    Qiang, Jipeng
    Yuan, Yunhao
    Wu, Xindong
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01): : 810 - 821
  • [26] Fine-Tuning for Few-Shot Image Classification by Multimodal Prototype Regularization
    Wu, Qianhao
    Qi, Jiaxin
    Zhang, Dong
    Zhang, Hanwang
    Tang, Jinhui
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8543 - 8556
  • [27] Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification
    Shi, Kai
    Wang, Wenzhen
    Liu, Qichao
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [28] Multi-level relation learning for cross-domain few-shot hyperspectral image classification
    Liu, Chun
    Yang, Longwei
    Li, Zheng
    Yang, Wei
    Han, Zhigang
    Guo, Jianzhong
    Yu, Junyong
    APPLIED INTELLIGENCE, 2024, 54 (05) : 4392 - 4410
  • [29] Multi-level relation learning for cross-domain few-shot hyperspectral image classification
    Chun Liu
    Longwei Yang
    Zheng Li
    Wei Yang
    Zhigang Han
    Jianzhong Guo
    Junyong Yu
    Applied Intelligence, 2024, 54 : 4392 - 4410
  • [30] Domain-Invariant Few-Shot Contrastive Learning for Hyperspectral Image Classification
    Chen, Wenchen
    Zhang, Yanmei
    Chu, Jianping
    Wang, Xingbo
    Applied Sciences (Switzerland), 2024, 14 (23):