FedASA: A Personalized Federated Learning With Adaptive Model Aggregation for Heterogeneous Mobile Edge Computing

被引:2
作者
Deng, Dongshang [1 ,2 ]
Wu, Xuangou [1 ,2 ]
Zhang, Tao [3 ,4 ]
Tang, Xiangyun [5 ]
Du, Hongyang [6 ]
Kang, Jiawen [7 ]
Liu, Jiqiang [8 ]
Niyato, Dusit [9 ]
机构
[1] Anhui Univ Technol, Sch Comp Sci & Technol, Maanshan 243002, Peoples R China
[2] Anhui Prov Key Lab Digital Twin Technol Met Ind, Maanshan 243002, Peoples R China
[3] Beijing Jiaotong Univ, Sch Cyberspace Sci & Technol, Beijing 100044, Peoples R China
[4] Anhui Engn Res Ctr Intelligent Applicat & Secur In, Beijing 100044, Peoples R China
[5] Minzu Univ China, Sch Informat Engn, Beijing 100081, Peoples R China
[6] Univ Hong Kong, Dept Elect & Elect Engn, Hong Kong, Peoples R China
[7] Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China
[8] Beijing Jiaotong Univ, Sch Cyberspace Sci & Technol, Beijing 100044, Peoples R China
[9] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore 639798, Singapore
基金
中国博士后科学基金; 新加坡国家研究基金会;
关键词
Computational modeling; Performance evaluation; Adaptation models; Accuracy; Servers; Internet of Things; Computer architecture; mobile edge computing; personalized federated learning; resource constraint; statistical heterogeneity;
D O I
10.1109/TMC.2024.3446271
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) opens a new promising paradigm for the Industrial Internet of Things (IoT) since it can collaboratively train machine learning models without sharing private data. However, deploying FL frameworks in real IoT scenarios faces three critical challenges, i.e., statistical heterogeneity, resource constraint, and fairness. To address these challenges, we design a fair and efficient FL method, termed FedASA, which can address the challenge of statistical heterogeneity in resource-constrained scenarios by determining the shared architecture adaptively. In FedASA, we first present a cell-wised shared architecture selection strategy, which can adaptively construct the shared architecture for each device. We then design a cell-based aggregation algorithm for aggregating heterogeneous shared architectures. In addition, we provide a theoretical analysis of the federated error bound, which provides a theoretical guarantee for the fairness. At the same time, we prove the convergence of FedASA at the first-order stationary point. We evaluate the performance of FedASA through extensive simulation and experiments. Experimental results in cross-location scenarios show that FedASA outperformed the state-of-the-art approaches, improving accuracy by up to 13.27% with better fairness and faster convergence and communication requirement has been reduced by 81.49%.
引用
收藏
页码:14787 / 14802
页数:16
相关论文
共 57 条
  • [1] FedOpt: Towards Communication Efficiency and Privacy Preservation in Federated Learning
    Asad, Muhammad
    Moustafa, Ahmed
    Ito, Takayuki
    [J]. APPLIED SCIENCES-BASEL, 2020, 10 (08):
  • [2] A theory of learning from different domains
    Ben-David, Shai
    Blitzer, John
    Crammer, Koby
    Kulesza, Alex
    Pereira, Fernando
    Vaughan, Jennifer Wortman
    [J]. MACHINE LEARNING, 2010, 79 (1-2) : 151 - 175
  • [3] ProtoHAR: Prototype Guided Personalized Federated Learning for Human Activity Recognition
    Cheng, Dongzhou
    Zhang, Lei
    Bu, Can
    Wang, Xing
    Wu, Hao
    Song, Aiguo
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (08) : 3900 - 3911
  • [4] Security and Privacy-Enhanced Federated Learning for Anomaly Detection in IoT Infrastructures
    Cui, Lei
    Qu, Youyang
    Xie, Gang
    Zeng, Deze
    Li, Ruidong
    Shen, Shigen
    Yu, Shui
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (05) : 3492 - 3500
  • [5] DecFFD: A Personalized Federated Learning Framework for Cross-Location Fault Diagnosis
    Deng, Dongshang
    Zhao, Wei
    Wu, Xuangou
    Zhang, Tao
    Zheng, Jinde
    Kang, Jiawen
    Niyato, Dusit
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (05) : 7082 - 7091
  • [6] Dinh CT, 2020, ADV NEUR IN, V33
  • [7] Cross-Domain Gradient Discrepancy Minimization for Unsupervised Domain Adaptation
    Du, Zhekai
    Li, Jingjing
    Su, Hongzu
    Zhu, Lei
    Lu, Ke
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 3936 - 3945
  • [8] Fallah A, 2020, Arxiv, DOI arXiv:2002.07948
  • [9] Arivazhagan MG, 2019, Arxiv, DOI arXiv:1912.00818
  • [10] Haddadpour F, 2019, ADV NEUR IN, V32