Prototype-Augmented Contrastive Learning for Few-Shot Unsupervised Domain Adaptation

被引:0
|
作者
Gong, Lu [1 ]
Zhang, Wen [1 ]
Li, Mingkang [1 ]
Zhang, Jiali [1 ]
Zhang, Zili [1 ]
机构
[1] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
关键词
Unsupervised domain adaptation; Self-supervised learning; Few-shot learning; Prototype learning; Contrastive learning;
D O I
10.1007/978-3-031-40292-0_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Unsupervised domain adaptation aims to learn a classification model from the source domain with much-supervised information, which is applied to the utterly unsupervised target domain. However, collecting enough labeled source samples is difficult in some scenarios, decreasing the effectiveness of previous approaches substantially. Therefore, a more challenging and applicable problem called few-shot unsupervised domain adaptation is considered in this work, where a classifier trained with only a few source labels needs to show strong generalization on the target domain. The prototype-based self-supervised learning method has presented superior performance improvements in addressing this problem, while the quality of the prototype could be further improved. To mitigate this situation, a novel Prototype-Augmented Contrastive Learning is proposed. A new computation strategy is utilized to rectify the source prototypes, which are then used to improve the target prototypes. To better learn semantic information and align features, both in-domain prototype contrastive learning and cross-domain prototype contrastive learning are performed. Extensive experiments are conducted on three widely used benchmarks: Office, OfficeHome, and DomainNet, achieving accuracy improvement of over 3%, 1%, and 0.5%, respectively, demonstrating the effectiveness of the proposed method.
引用
收藏
页码:197 / 210
页数:14
相关论文
共 50 条
  • [21] Interpretable Few-Shot Learning with Contrastive Constraint
    Zhang L.
    Chen Y.
    Wu W.
    Wei B.
    Luo X.
    Chang X.
    Liu J.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (12): : 2573 - 2584
  • [22] Diversified Contrastive Learning For Few-Shot Classification
    Lu, Guangtong
    Li, Fanzhang
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT I, 2023, 14254 : 147 - 158
  • [23] Few-shot time-series anomaly detection with unsupervised domain adaptation
    Li, Hongbo
    Zheng, Wenli
    Tang, Feilong
    Zhu, Yanmin
    Huang, Jielong
    INFORMATION SCIENCES, 2023, 649
  • [24] Prototype and Instance Contrastive Learning for Unsupervised Domain Adaptation in Speaker Verification
    Huang, Wen
    Han, Bing
    Chen, Zhengyang
    Wang, Shuai
    Qian, Yanmin
    2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, ISCSLP 2024, 2024, : 383 - 387
  • [25] Spatial Contrastive Learning for Few-Shot Classification
    Ouali, Yassine
    Hudelot, Celine
    Tami, Myriam
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, 2021, 12975 : 671 - 686
  • [26] Confidence-based Visual Dispersal for Few-shot Unsupervised Domain Adaptation
    Xiong, Yizhe
    Chen, Hui
    Lin, Zijia
    Zhao, Sicheng
    Ding, Guiguang
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 11587 - 11597
  • [27] Learning a Few-shot Embedding Model with Contrastive Learning
    Liu, Chen
    Fu, Yanwei
    Xu, Chengming
    Yang, Siqian
    Li, Jilin
    Wang, Chengjie
    Zhang, Li
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8635 - 8643
  • [28] Augmenting Few-Shot Learning With Supervised Contrastive Learning
    Lee, Taemin
    Yoo, Sungjoo
    IEEE ACCESS, 2021, 9 : 61466 - 61474
  • [29] Contrastive enhancement using latent prototype for few-shot segmentation
    Zhao, Xiaoyu
    Chen, Xiaoqian
    Gong, Zhiqiang
    Yao, Wen
    Zhang, Yunyang
    Zheng, Xiaohu
    DIGITAL SIGNAL PROCESSING, 2024, 144
  • [30] Few-Shot Learning Using Residual Channel Attention and Prototype Domain Adaptation for Hyperspectral Image Classification
    Ye, Zhen
    Sun, Tao
    Cao, Zhan
    Bai, Lin
    Fowler, James E.
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20