Personalized Retrogress-Resilient Federated Learning Toward Imbalanced Medical Data

被引:57
作者
Chen, Zhen [1 ]
Yang, Chen [1 ]
Zhu, Meilu [1 ]
Peng, Zhe [2 ]
Yuan, Yixuan [1 ]
机构
[1] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
[2] Hong Kong Baptist Univ, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Federated learning; retrogress; class imbalance; dermoscopic diagnosis; prostate segmentation; PROSTATE SEGMENTATION; MRI;
D O I
10.1109/TMI.2022.3192483
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Clinically oriented deep learning algorithms, combined with large-scale medical datasets, have significantly promoted computer-aided diagnosis. To address increasing ethical and privacy issues, Federated Learning (FL) adopts a distributed paradigm to collaboratively train models, rather than collecting samples from multiple institutions for centralized training. Despite intensive research on FL, two major challenges are still existing when applying FL in the real-world medical scenarios, including the performance degradation (i.e., retrogress) after each communication and the intractable class imbalance. Thus, in this paper, we propose a novel personalized FL framework to tackle these two problems. For the retrogress problem, we first devise a Progressive Fourier Aggregation (PFA) at the server side to gradually integrate parameters of client models in the frequency domain. Then, at the client side, we design a Deputy-Enhanced Transfer (DET) to smoothly transfer global knowledge to the personalized local model. For the class imbalance problem, we propose the Conjoint Prototype-Aligned (CPA) loss to facilitate the balanced optimization of the FL framework. Considering the inaccessibility of private local data to other participants in FL, the CPA loss calculates the global conjoint objective based on global imbalance, and then adjusts the client-side local training through the prototype-aligned refinement to eliminate the imbalance gap with such a balanced goal. Extensive experiments are performed on real-world dermoscopic and prostate MRI FL datasets. The experimental results demonstrate the advantages of our FL framework in real-world medical scenarios, by outperforming state-of-the-art FL methods with a large margin. The source code is available at < uri > https://github.com/CityU-AIM-Group/PRR-Imbalance.
引用
收藏
页码:3663 / 3674
页数:12
相关论文
共 47 条
[1]   Siloed Federated Learning for Multi-centric Histopathology Datasets [J].
Andreux, Mathieu ;
du Terrail, Jean Ogier ;
Beguier, Constance ;
Tramel, Eric W. .
DOMAIN ADAPTATION AND REPRESENTATION TRANSFER, AND DISTRIBUTED AND COLLABORATIVE LEARNING, DART 2020, DCL 2020, 2020, 12444 :129-139
[2]  
Bloch N., 2015, Cancer Imag. Arch.
[3]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[4]  
Chen Z, 2021, LECT NOTES COMPUT SC, V12903, P347, DOI [10.1007/978-3-030-87199-4_33, 10.1007/978-981-16-1160-5_27]
[5]  
Chen Z, 2021, AAAI CONF ARTIF INTE, V35, P47
[6]  
Codella NCF, 2018, I S BIOMED IMAGING, P168, DOI 10.1109/ISBI.2018.8363547
[7]  
Deng YY, 2020, Arxiv, DOI arXiv:2003.13461
[8]  
Dinh CT, 2020, ADV NEUR IN, V33
[9]   Federated deep learning for detecting COVID-19 lung abnormalities in CT: a privacy-preserving multinational validation study [J].
Dou, Qi ;
So, Tiffany Y. ;
Jiang, Meirui ;
Liu, Quande ;
Vardhanabhuti, Varut ;
Kaissis, Georgios ;
Li, Zeju ;
Si, Weixin ;
Lee, Heather H. C. ;
Yu, Kevin ;
Feng, Zuxin ;
Dong, Li ;
Burian, Egon ;
Jungmann, Friederike ;
Braren, Rickmer ;
Makowski, Marcus ;
Kainz, Bernhard ;
Rueckert, Daniel ;
Glocker, Ben ;
Yu, Simon C. H. ;
Heng, Pheng Ann .
NPJ DIGITAL MEDICINE, 2021, 4 (01)
[10]   Dermatologist-level classification of skin cancer with deep neural networks [J].
Esteva, Andre ;
Kuprel, Brett ;
Novoa, Roberto A. ;
Ko, Justin ;
Swetter, Susan M. ;
Blau, Helen M. ;
Thrun, Sebastian .
NATURE, 2017, 542 (7639) :115-+