Multi-Source Collaborative Contrastive Learning for Decentralized Domain Adaptation

被引:13
作者
Wei, Yikang [1 ]
Yang, Liu [1 ]
Han, Yahong [1 ]
Hu, Qinghua [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin Key Lab Machine Learning, Tianjin 300350, Peoples R China
关键词
Adaptation models; Feature extraction; Data models; Collaboration; Data mining; Training; Bridges; Multi-source domain adaptation; data decentralization; contrastive learning; UNSUPERVISED DOMAIN;
D O I
10.1109/TCSVT.2022.3219893
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Unsupervised multi-source domain adaptation aims to obtain a model working well on the unlabeled target domain by reducing the domain gap between the labeled source domains and the unlabeled target domain. Considering the data privacy and storage cost, data from multiple source domains and target domain are isolated and decentralized. This data decentralization scenario brings the difficulty of domain alignment for reducing the domain gap between the decentralized source domains and target domain, respectively. For conducting domain alignment under the data decentralization scenario, we propose Multi-source Collaborative Contrastive learning for decentralized Domain Adaptation (MCC-DA). The models from other domains are used as the bridge to reduce the domain gap. On the source domains and target domain, we penalize the inconsistency of data features extracted from the source domain models and target domain model by contrastive alignment. With the collaboration of source domain models and target domain model, the domain gap between decentralized source domains and target domain is reduced without accessing the data from other domains. The experiment results on multiple benchmarks indicate that our method can reduce the domain gap effectively and outperform the state-of-the-art methods significantly.
引用
收藏
页码:2202 / 2216
页数:15
相关论文
共 70 条
  • [1] Unsupervised Multi-source Domain Adaptation Without Access to Source Data
    Ahmed, Sk Miraj
    Raychaudhuri, Dripta S.
    Paul, Sujoy
    Oymak, Samet
    Roy-Chowdhury, Amit K.
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 10098 - 10107
  • [2] Unsupervised Multi-Source Domain Adaptation for Person Re-Identification
    Bai, Zechen
    Wang, Zhigang
    Wang, Jian
    Hu, Di
    Ding, Errui
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12909 - 12918
  • [3] A theory of learning from different domains
    Ben-David, Shai
    Blitzer, John
    Crammer, Koby
    Kulesza, Alex
    Pereira, Fernando
    Vaughan, Jennifer Wortman
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 151 - 175
  • [4] From Big to Small: Adaptive Learning to Partial-Set Domains
    Cao, Zhangjie
    You, Kaichao
    Zhang, Ziyang
    Wang, Jianmin
    Long, Mingsheng
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (02) : 1766 - 1780
  • [5] Chen T, 2020, PR MACH LEARN RES, V119
  • [6] Transferrable Contrastive Learning for Visual Domain Adaptation*
    Chen, Yang
    Pan, Yingwei
    Wang, Yu
    Yao, Ting
    Tian, Xinmei
    Mei, Tao
    [J]. PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3399 - 3408
  • [7] Randaugment: Practical automated data augmentation with a reduced search space
    Cubuk, Ekin D.
    Zoph, Barret
    Shlens, Jonathon
    Le, Quoc, V
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 3008 - 3017
  • [8] Disentangling Task-Oriented Representations for Unsupervised Domain Adaptation
    Dai, Pingyang
    Chen, Peixian
    Wu, Qiong
    Hong, Xiaopeng
    Ye, Qixiang
    Tian, Qi
    Chia-Wen Lin
    Ji, Rongrong
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1012 - 1026
  • [9] Where and How to Transfer: Knowledge Aggregation-Induced Transferability Perception for Unsupervised Domain Adaptation
    Dong, Jiahua
    Cong, Yang
    Sun, Gan
    Fang, Zhen
    Ding, Zhengming
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1664 - 1681
  • [10] What Can Be Transferred: Unsupervised Domain Adaptation for Endoscopic Lesions Segmentation
    Dong, Jiahua
    Cong, Yang
    Sun, Gan
    Zhong, Bineng
    Xu, Xiaowei
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 4022 - 4031