A framework for self-supervised federated domain adaptation

被引:0
作者
Bin Wang
Gang Li
Chao Wu
WeiShan Zhang
Jiehan Zhou
Ye Wei
机构
[1] China University of Petroleum (East),College of Computer Science and Technology
[2] ZheJiang University,School of Public Affairs
[3] University of Oulu,undefined
[4] Suzhou Tongji Blockchain Research Institute,undefined
来源
EURASIP Journal on Wireless Communications and Networking | / 2022卷
关键词
Domain adaptation; Distributed system; Self-supervised; Federated learning;
D O I
暂无
中图分类号
学科分类号
摘要
Unsupervised federated domain adaptation uses the knowledge from several distributed unlabelled source domains to complete the learning on the unlabelled target domain. Some of the existing methods have limited effectiveness and involve frequent communication. This paper proposes a framework to solve the distributed multi-source domain adaptation problem, referred as self-supervised federated domain adaptation (SFDA). Specifically, a multi-domain model generalization balance is proposed to aggregate the models from multiple source domains in each round of communication. A weighted strategy based on centroid similarity is also designed for SFDA. SFDA conducts self-supervised training on the target domain to tackle domain shift. Compared with the classical federated adversarial domain adaptation algorithm, SFDA is not only strong in communication cost and privacy protection but also improves in the accuracy of the model.
引用
收藏
相关论文
共 50 条
[21]   FGSS: Federated global self-supervised framework for large-scale unlabeled data [J].
Zhang, Chen ;
Xie, Zixuan ;
Yu, Bin ;
Wen, Chao ;
Xie, Yu .
APPLIED SOFT COMPUTING, 2023, 143
[22]   Cuepervision: self-supervised learning for continuous domain adaptation without catastrophic forgetting [J].
Schutera, Mark ;
Hafner, Frank M. ;
Abhau, Jochen ;
Hagenmeyer, Veit ;
Mikut, Ralf ;
Reischl, Markus .
IMAGE AND VISION COMPUTING, 2021, 106
[23]   Domain Adaptation With Self-Supervised Learning and Feature Clustering for Intelligent Fault Diagnosis [J].
Lu, Nannan ;
Xiao, Hanhan ;
Ma, Zhanguo ;
Yan, Tong ;
Han, Min .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (06) :7657-7670
[24]   Generic network for domain adaptation based on self-supervised learning and deep clustering [J].
Baffour, Adu Asare ;
Qin, Zhen ;
Geng, Ji ;
Ding, Yi ;
Deng, Fuhu ;
Qin, Zhiguang .
NEUROCOMPUTING, 2022, 476 :126-136
[25]   Self-supervised learning minimax entropy domain adaptation for the underwater target recognition [J].
Yang, Jirui ;
Yan, Shefeng ;
Zeng, Di ;
Tan, Gang .
APPLIED ACOUSTICS, 2024, 216
[26]   MoDA: Map Style Transfer for Self-supervised Domain Adaptation of Embodied Agents [J].
Lee, Eun Sun ;
Kim, Junho ;
Park, SangWon ;
Kim, Young Min .
COMPUTER VISION, ECCV 2022, PT XXXIX, 2022, 13699 :338-354
[27]   CONTINUAL SELF-SUPERVISED DOMAIN ADAPTATION FOR END-TO-END SPEAKER DIARIZATION [J].
Coria, Juan M. ;
Bredin, Herve ;
Ghannay, Sahar ;
Rosset, Sophie .
2022 IEEE SPOKEN LANGUAGE TECHNOLOGY WORKSHOP, SLT, 2022, :626-632
[28]   Generative and self-supervised domain adaptation for one-stage object detection [J].
Fujii, Kazuma ;
Kawamoto, Kazuhiko .
ARRAY, 2021, 11
[29]   FEDERATED SELF-SUPERVISED LEARNING FOR ACOUSTIC EVENT CLASSIFICATION [J].
Feng, Meng ;
Kao, Chieh-Chi ;
Tang, Qingming ;
Sun, Ming ;
Rozgic, Viktor ;
Matsoukas, Spyros ;
Wang, Chao .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :481-485
[30]   A Deep Cut Into Split Federated Self-Supervised Learning [J].
Przewiezlikowski, Marcin ;
Osial, Marcin ;
Zielinski, Bartosz ;
Smieja, Marek .
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES: RESEARCH TRACK, PT II, ECML PKDD 2024, 2024, 14942 :444-459