A framework for self-supervised federated domain adaptation

被引:0
作者
Bin Wang
Gang Li
Chao Wu
WeiShan Zhang
Jiehan Zhou
Ye Wei
机构
[1] China University of Petroleum (East),College of Computer Science and Technology
[2] ZheJiang University,School of Public Affairs
[3] University of Oulu,undefined
[4] Suzhou Tongji Blockchain Research Institute,undefined
来源
EURASIP Journal on Wireless Communications and Networking | / 2022卷
关键词
Domain adaptation; Distributed system; Self-supervised; Federated learning;
D O I
暂无
中图分类号
学科分类号
摘要
Unsupervised federated domain adaptation uses the knowledge from several distributed unlabelled source domains to complete the learning on the unlabelled target domain. Some of the existing methods have limited effectiveness and involve frequent communication. This paper proposes a framework to solve the distributed multi-source domain adaptation problem, referred as self-supervised federated domain adaptation (SFDA). Specifically, a multi-domain model generalization balance is proposed to aggregate the models from multiple source domains in each round of communication. A weighted strategy based on centroid similarity is also designed for SFDA. SFDA conducts self-supervised training on the target domain to tackle domain shift. Compared with the classical federated adversarial domain adaptation algorithm, SFDA is not only strong in communication cost and privacy protection but also improves in the accuracy of the model.
引用
收藏
相关论文
共 50 条
[31]   Self-Supervised Federated Learning for Fast MR Imaging [J].
Zou, Juan ;
Pei, Tingrui ;
Li, Cheng ;
Wu, Ruoyou ;
Wang, Shanshan .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 :1-11
[32]   Incremental Layer-Wise Self-Supervised Learning for Efficient Unsupervised Speech Domain Adaptation On Device [J].
Huo, Zhouyuan ;
Hwang, Dongseong ;
Sim, Khe Chai ;
Garg, Shefali ;
Misra, Ananya ;
Siddhartha, Nikhil ;
Strohman, Trevor ;
Beaufays, Francoise .
INTERSPEECH 2022, 2022, :4845-4849
[33]   SIDA: Self-Supervised Imbalanced Domain Adaptation for Sound Enhancement and Cross-Domain WiFi Sensing [J].
Zhang, Jin ;
Dai, Yuyan ;
Chen, Jie ;
Luo, Chengwen ;
Wei, Bo ;
Leung, Victor C. M. ;
Li, Jianqiang .
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2023, 7 (03)
[34]   A Collaborative Self-Supervised Domain Adaptation for Low-Quality Medical Image Enhancement [J].
Hou, Qingshan ;
Wang, Yaqi ;
Cao, Peng ;
Cheng, Shuai ;
Lan, Linqi ;
Yang, Jinzhu ;
Liu, Xiaoli ;
Zaiane, Osmar R. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2024, 43 (07) :2479-2494
[35]   CLA: A self-supervised contrastive learning method for leaf disease identification with domain adaptation [J].
Zhao, Ruzhun ;
Zhu, Yuchang ;
Li, Yuanhong .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2023, 211
[36]   Towards Better Domain Adaptation for Self-Supervised Models: A Case Study of Child ASR [J].
Fan, Ruchao ;
Zhu, Yunzheng ;
Wang, Jinhan ;
Alwan, Abeer .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (06) :1242-1252
[37]   Combining Self-supervised Learning and Adversarial Training based Domain Adaptation for Speaker Verification [J].
Chen, Zhengyang ;
Wang, Shuai ;
Han, Bing ;
Qian, Yanmin .
2024 IEEE 14TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING, ISCSLP 2024, 2024, :701-705
[38]   Self-Supervised CycleGAN for Object-Preserving Image-to-Image Domain Adaptation [J].
Xie, Xinpeng ;
Chen, Jiawei ;
Li, Yuexiang ;
Shen, Linlin ;
Ma, Kai ;
Zheng, Yefeng .
COMPUTER VISION - ECCV 2020, PT XX, 2020, 12365 :498-513
[39]   Self-Supervised Temporal Consistency applied to Domain Adaptation in Semantic Segmentation of Urban Scenes [J].
Barbosa, Felipe M. ;
Osorio, Fernando S. .
2023 LATIN AMERICAN ROBOTICS SYMPOSIUM, LARS, 2023 BRAZILIAN SYMPOSIUM ON ROBOTICS, SBR, AND 2023 WORKSHOP ON ROBOTICS IN EDUCATION, WRE, 2023, :555-560
[40]   FedUTN: federated self-supervised learning with updating target network [J].
Simou Li ;
Yuxing Mao ;
Jian Li ;
Yihang Xu ;
Jinsen Li ;
Xueshuo Chen ;
Siyang Liu ;
Xianping Zhao .
Applied Intelligence, 2023, 53 :10879-10892