FAM: Adaptive federated meta-learning for MRI data

被引:2
|
作者
Sinha, Indrajeet Kumar [1 ]
Verma, Shekhar [1 ]
Singh, Krishna Pratap [1 ]
机构
[1] Indian Inst Informat Technol Allahabad, Dept Informat Technol, Prayagraj 211015, Uttar Pradesh, India
关键词
Federated learning; MAML; Lottery ticket hypothesis; Sparse models; Sparsifying;
D O I
10.1016/j.patrec.2024.09.018
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Federated learning enables multiple clients to collaborate to train a model without sharing data. Clients with insufficient data or data diversity participate in federated learning to learn a model with superior performance. MRI data suffers from inadequate data and different data distribution due to differences in MRI scanners and client characteristics. Also, privacy concerns preclude data sharing. In this work, we propose a novel adaptive federated meta-learning (FAM) mechanism for collaboratively learning a single global model, which is personalized locally on individual clients. The learnt sparse global model captures the common features in the MRI data across clients. This model is grown on each client to learn a personalized model by capturing additional client-specific parameters from local data. Experimental results on multiple data sets show that the personalization process at each client quickly converges using a limited number of epochs. The personalized client models outperformed the locally trained models, demonstrating the efficacy of the FAM mechanism. Additionally, the FAM-based sparse global model has fewer parameters that require less communication overhead during federated learning. This makes the model viable for networks with limited resources.
引用
收藏
页码:205 / 212
页数:8
相关论文
共 50 条
  • [21] Federated Meta-Learning on Graph for Traffic Flow Prediction
    Feng, Xinxin
    Sun, Haoran
    Liu, Shunjian
    Guo, Junxin
    Zheng, Haifeng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (12) : 19526 - 19538
  • [22] A Novel Federated Meta-Learning Approach for Discriminating Sedentary Behavior From Wearable Data
    Barros, Pedro H.
    Guevara, Judy C.
    Villas, Leandro
    Guidoni, Daniel
    da Fonseca, Nelson L. S.
    Ramos, Heitor S.
    IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (19): : 31909 - 31916
  • [23] Adaptive Code Completion with Meta-learning
    Fang, Liyu
    Huang, Zhiqiu
    Zhou, Yu
    Chen, Taolue
    THE 12TH ASIA-PACIFIC SYMPOSIUM ON INTERNETWARE, INTERNETWARE 2020, 2021, : 116 - 125
  • [24] Data Augmentation for Meta-Learning
    Ni, Renkun
    Goldblum, Micah
    Sharaf, Amr
    Kong, Kezhi
    Goldstein, Tom
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 139, 2021, 139
  • [25] Meta-learning for Adaptive Image Segmentation
    Sellaouti, Aymen
    Jaafra, Yasmina
    Hamouda, Atef
    IMAGE ANALYSIS AND RECOGNITION, ICIAR 2014, PT I, 2014, 8814 : 187 - 197
  • [26] Data Efficiency of Meta-learning
    Al-Shedivat, Maruan
    Li, Liam
    Xing, Eric
    Talwalkar, Ameet
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [27] Meta-learning with an Adaptive Task Scheduler
    Yao, Huaxiu
    Wang, Yu
    Wei, Ying
    Zhao, Peilin
    Mahdavi, Mehrdad
    Lian, Defu
    Finn, Chelsea
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [28] Squeezing More Utility via Adaptive Clipping on Differentially Private Gradients in Federated Meta-Learning
    Wang, Ning
    Xiao, Yang
    Chen, Yimin
    Zhang, Ning
    Lou, Wenjing
    Hou, Y. Thomas
    PROCEEDINGS OF THE 38TH ANNUAL COMPUTER SECURITY APPLICATIONS CONFERENCE, ACSAC 2022, 2022, : 647 - 657
  • [29] Personalized Federated Learning on Non-IID Data via Group-based Meta-learning
    Yang, Lei
    Huang, Jiaming
    Lin, Wanyu
    Cao, Jiannong
    ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2023, 17 (04)
  • [30] A Personalized Federated Learning Algorithm Based on Meta-Learning and Knowledge Distillation
    Sun Y.
    Shi Y.
    Wang Z.
    Li M.
    Si P.
    Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications, 2023, 46 (01): : 12 - 18