Toward Better Generalization of Cross-Domain Few-Shot Classification in Tibetan Character With Contrastive Learning and Meta Fine-Tuning

被引:0
作者
Bao, Xun [1 ]
Wang, Weilan [1 ,2 ]
Wang, Xiaojuan [1 ,2 ]
Zhao, Guanzhong [1 ]
Li, Huarui [1 ]
Liu, Meiling [1 ]
机构
[1] Northwest Minzu Univ, Key Lab Chinas Ethn Languages & Informat Technol, Minist Educ, Lanzhou 730030, Peoples R China
[2] Northwest Minzu Univ, Sch Math & Comp Sci, Lanzhou 730030, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Contrastive learning; Data augmentation; Text recognition; Data models; Few shot learning; Feature extraction; Transfer learning; Cross-domain few-shot learning; contrastive learning; meta learning; transfer learning;
D O I
10.1109/ACCESS.2024.3459933
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Few-shot classification aims to classify unseen classes (query instances) with few labeled samples from each class (support instances). However, current few-shot learning methods assume that the training and testing sets obey the same distribution. When there exists a huge domain gap between the training and testing sets, they fail to generalize well across domains. In this work, we tackle the cross-domain few-shot learning (CD-FSL) problem in Tibetan characters from two perspectives. In the meta-training phase, we seamlessly introduce contrastive learning into the episodic training paradigm and apply a data augmentation strategy to seek better feature representations thereby improving the ability to recognize unseen categories. In the meta-finetuning phase, we then integrate the above algorithm into transfer learning and propose a fine-tuning method that generates episodic synthetic query sets to enhance generalization capability across domains. These two stages force the model to overcome the domain shift between training and testing sets. Extensive experiments show that our simple approach allows us to establish competitive results on the well-known few-shot learning dataset Omniglot and state-of-the-art results on our Tibetan character datasets. The code will be publicly available in this repository: https://github.com/coder-bossin/fs-TCR.
引用
收藏
页码:134439 / 134452
页数:14
相关论文
共 50 条
[21]   Covariance-based metric model for cross-domain few-shot classification and learning-to-generalization [J].
Nadeem Yousuf Khanday ;
Shabir Ahmad Sofi .
Applied Intelligence, 2023, 53 :27374-27391
[22]   Covariance-based metric model for cross-domain few-shot classification and learning-to-generalization [J].
Khanday, Nadeem Yousuf ;
Sofi, Shabir Ahmad .
APPLIED INTELLIGENCE, 2023, 53 (22) :27374-27391
[23]   A Comparison of Machine Learning Methods for Cross-Domain Few-Shot Learning [J].
Wang, Hongyu ;
Gouk, Henry ;
Frank, Eibe ;
Pfahringer, Bernhard ;
Mayo, Michael .
AI 2020: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2020, 12576 :445-457
[24]   Adaptive fine-tuning strategy for few-shot learning [J].
Zhuang, Xinkai ;
Shao, Mingwen ;
Gao, Wei ;
Yang, Jianxin .
JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (06)
[25]   Few-Shot MS and PAN Joint Classification With Improved Cross-Source Contrastive Learning [J].
Zhu, Hao ;
Guo, Pute ;
Hou, Biao ;
Li, Xiaotong ;
Jiao, Changzhe ;
Ren, Bo ;
Jiao, Licheng ;
Wang, Shuang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[26]   Dynamic Weight-Optimized Prototypical Contrastive Network for Cross-Domain Few-Shot Bearing Fault Diagnosis [J].
Li, Donglin ;
Yao, Yuqi ;
Zhang, Yuxian ;
Xu, Jiacan ;
Wang, Qisen .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 :18889-18899
[27]   Few-Shot Learning With Prototype Rectification for Cross-Domain Hyperspectral Image Classification [J].
Qin, Anyong ;
Yuan, Chaoqi ;
Li, Qiang ;
Luo, Xiaoliu ;
Yang, Feng ;
Song, Tiecheng ;
Gao, Chenqiang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
[28]   An Adversarial Meta-Training Framework for Cross-Domain Few-Shot Learning [J].
Tian, Pinzhuo ;
Xie, Shaorong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :6881-6891
[29]   Meta-collaborative comparison for effective cross-domain few-shot learning [J].
Zhou, Fei ;
Wang, Peng ;
Zhang, Lei ;
Wei, Wei ;
Zhang, Yanning .
PATTERN RECOGNITION, 2024, 156
[30]   Convert Cross-Domain Classification Into Few-Shot Learning: A Unified Prompt-Tuning Framework for Unsupervised Domain Adaptation [J].
Zhu, Yi ;
Shen, Hui ;
Li, Yun ;
Qiang, Jipeng ;
Yuan, Yunhao ;
Wu, Xindong .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2025, 9 (01) :810-821