Prototype-Augmented Contrastive Learning for Few-Shot Unsupervised Domain Adaptation

被引:0
|
作者
Gong, Lu [1 ]
Zhang, Wen [1 ]
Li, Mingkang [1 ]
Zhang, Jiali [1 ]
Zhang, Zili [1 ]
机构
[1] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT IV, KSEM 2023 | 2023年 / 14120卷
关键词
Unsupervised domain adaptation; Self-supervised learning; Few-shot learning; Prototype learning; Contrastive learning;
D O I
10.1007/978-3-031-40292-0_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptation aims to learn a classification model from the source domain with much-supervised information, which is applied to the utterly unsupervised target domain. However, collecting enough labeled source samples is difficult in some scenarios, decreasing the effectiveness of previous approaches substantially. Therefore, a more challenging and applicable problem called few-shot unsupervised domain adaptation is considered in this work, where a classifier trained with only a few source labels needs to show strong generalization on the target domain. The prototype-based self-supervised learning method has presented superior performance improvements in addressing this problem, while the quality of the prototype could be further improved. To mitigate this situation, a novel Prototype-Augmented Contrastive Learning is proposed. A new computation strategy is utilized to rectify the source prototypes, which are then used to improve the target prototypes. To better learn semantic information and align features, both in-domain prototype contrastive learning and cross-domain prototype contrastive learning are performed. Extensive experiments are conducted on three widely used benchmarks: Office, OfficeHome, and DomainNet, achieving accuracy improvement of over 3%, 1%, and 0.5%, respectively, demonstrating the effectiveness of the proposed method.
引用
收藏
页码:197 / 210
页数:14
相关论文
共 50 条
  • [1] Domain consensual contrastive learning for few-shot universal domain adaptation
    Liao, Haojin
    Wang, Qiang
    Zhao, Sicheng
    Xing, Tengfei
    Hu, Runbo
    APPLIED INTELLIGENCE, 2023, 53 (22) : 27191 - 27206
  • [2] Domain consensual contrastive learning for few-shot universal domain adaptation
    Haojin Liao
    Qiang Wang
    Sicheng Zhao
    Tengfei Xing
    Runbo Hu
    Applied Intelligence, 2023, 53 : 27191 - 27206
  • [3] Contrastive prototype learning with semantic patchmix for few-shot image classification
    Dong, Mengping
    Lei, Fei
    Li, Zhenbo
    Liu, Xue
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 142
  • [4] Unsupervised contrastive learning for few-shot TOC prediction and application
    Wang, Huijun
    Lu, Shuangfang
    Qiao, Lu
    Chen, Fangwen
    He, Xipeng
    Gao, Yuqiao
    Mei, Junwei
    INTERNATIONAL JOURNAL OF COAL GEOLOGY, 2022, 259
  • [5] Few-Shot Classification with Contrastive Learning
    Yang, Zhanyuan
    Wang, Jinghua
    Zhu, Yingying
    COMPUTER VISION, ECCV 2022, PT XX, 2022, 13680 : 293 - 309
  • [6] Interpretable Few-Shot Learning with Contrastive Constraint
    Zhang L.
    Chen Y.
    Wu W.
    Wei B.
    Luo X.
    Chang X.
    Liu J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (12): : 2573 - 2584
  • [7] Diversified Contrastive Learning For Few-Shot Classification
    Lu, Guangtong
    Li, Fanzhang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 147 - 158
  • [8] Few-shot time-series anomaly detection with unsupervised domain adaptation
    Li, Hongbo
    Zheng, Wenli
    Tang, Feilong
    Zhu, Yanmin
    Huang, Jielong
    INFORMATION SCIENCES, 2023, 649
  • [9] Spatial Contrastive Learning for Few-Shot Classification
    Ouali, Yassine
    Hudelot, Celine
    Tami, Myriam
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 671 - 686
  • [10] Prototype and Instance Contrastive Learning for Unsupervised Domain Adaptation in Speaker Verification
    Huang, Wen
    Han, Bing
    Chen, Zhengyang
    Wang, Shuai
    Qian, Yanmin
    2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, ISCSLP 2024, 2024, : 383 - 387