Personalized Federated Learning With Adaptive Batchnorm for Healthcare

被引:33
作者
Lu, Wang [1 ,2 ]
Wang, Jindong [3 ]
Chen, Yiqiang [4 ]
Qin, Xin [1 ,2 ]
Xu, Renjun [5 ]
Dimitriadis, Dimitrios [6 ]
Qin, Tao [3 ]
机构
[1] Univ Chinese Acad Sci, Beijing 101408, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Beijing 100045, Peoples R China
[3] Microsoft Res Asia, Beijing 100080, Peoples R China
[4] Chinese Acad Sci, Pengcheng Lab, Inst Comp Technol, Shenzhen 518066, Peoples R China
[5] Zhejiang Univ, Hangzhou 310027, Peoples R China
[6] Microsoft Res, Redmond, WA 98052 USA
关键词
Medical services; Collaborative work; Data models; Adaptation models; Computational modeling; Machine learning; Data privacy; Distributed computing; federated learning; personalization; batch normalization; healthcare;
D O I
10.1109/TBDATA.2022.3177197
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There is a growing interest in applying machine learning techniques to healthcare. Recently, federated learning (FL) is gaining popularity since it allows researchers to train powerful models without compromising data privacy and security. However, the performance of existing FL approaches often deteriorates when encountering non-iid situations where there exist distribution gaps among clients, and few previous efforts focus on personalization in healthcare. In this article, we propose FedAP to tackle domain shifts and then obtain personalized models for local clients. FedAP learns the similarity between clients based on the statistics of the batch normalization layers while preserving the specificity of each client with different local batch normalization. Comprehensive experiments on five healthcare benchmarks demonstrate that FedAP achieves better accuracy compared to state-of-the-art methods (e.g., 10%+ accuracy improvement for PAMAP2) with faster convergence speed.
引用
收藏
页码:915 / 925
页数:11
相关论文
共 66 条
[1]   A Survey on Federated Learning: The Journey From Centralized to Distributed On-Site Learning and Beyond [J].
AbdulRahman, Sawsan ;
Tout, Hanine ;
Ould-Slimane, Hakima ;
Mourad, Azzam ;
Talhi, Chamseddine ;
Guizani, Mohsen .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (07) :5476-5497
[2]  
Agarwal N, 2018, ADV NEUR IN, V31
[3]   Impacts of Telemanipulation in Robotic Assisted Surgery [J].
Avellino, Ignacio ;
Bailly, Gilles ;
Canlorbe, Geoffroy ;
Belghiti, Jeremie ;
Morel, Guillaume ;
Vitrani, Marie-Aude .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[4]  
Bilic P, 2022, Arxiv, DOI arXiv:1901.04056
[5]   Rethinking Zero-shot Video Classification: End-to-end Training for Realistic Applications [J].
Brattoli, Biagio ;
Tighe, Joseph ;
Zhdanov, Fedor ;
Perona, Pietro ;
Chalupka, Krzysztof .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :4612-4622
[6]  
Cao XY, 2021, AAAI CONF ARTIF INTE, V35, P6885
[7]   Domain-Specific Batch Normalization for Unsupervised Domain Adaptation [J].
Chang, Woong-Gi ;
You, Tackgeun ;
Seo, Seonguk ;
Kwak, Suha ;
Han, Bohyung .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7346-7354
[8]   FedHealth: A Federated Transfer Learning Framework for Wearable Healthcare [J].
Chen, Yiqiang ;
Qin, Xin ;
Wang, Jindong ;
Yu, Chaohui ;
Gao, Wen .
IEEE INTELLIGENT SYSTEMS, 2020, 35 (04) :83-93
[9]  
Chen YQ, 2017, IEEE INT C BIOINFORM, P939, DOI 10.1109/BIBM.2017.8217783
[10]  
Chen Z, 2021, AAAI CONF ARTIF INTE, V35, P47