Accelerated Federated Learning with Dynamic Model Partitioning for H-IoT

被引:0
作者
He, Peng [1 ]
Lan, Chunhui
Cui, Yaping
Wang, Ruyan
Wu, Dapeng
机构
[1] Chongqing Univ Posts & Telecommun, Sch Commun & Informat Engn, Chongqing, Peoples R China
来源
2023 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE, WCNC | 2023年
关键词
Federated learning; split learning; data privacy; Lyapunov optimization;
D O I
10.1109/WCNC55385.2023.10118865
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the Healthcare Internet of Things (H-IoT), Federated Learning (FL) is a promising solution for processing huge amounts of medical data. At present, FL applied in H-IoT still faces many challenges such as low training efficiency and high data privacy risk. In this work, we develop a three-layer FL architecture, which introduces split learning to both prevent the leakage of medical data and improve training efficiency according to the inherent properties of Neural Networks (NN). Moreover, we formulate a long-term optimization problem with the goal of accelerating training speed of models in H-IoT. Then, an online model partitioning algorithm namely Privacy-aware Model Partitioning Algorithm (PMPA) is derived based on Lyapunov optimization theory that enables mobile devices of the FL architecture to efficiently train local models and protect the data privacy. Furthermore, the simulation results show that compared with traditional FL, the local training delay of the proposed algorithm can be reduced by 28.94% and 39.89%, respectively.
引用
收藏
页数:6
相关论文
共 11 条
  • [1] Privacy Enhancing Technologies in the Internet of Things: Perspectives and Challenges
    Cha, Shi-Cho
    Hsu, Tzu-Yang
    Xiang, Yang
    Yeh, Kuo-Hui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (02): : 2159 - 2187
  • [2] Comparison of Privacy-Preserving Distributed Deep Learning Methods in Healthcare
    Gawali, Manish
    Arvind, C. S.
    Suryavanshi, Shriya
    Madaan, Harshit
    Gaikwad, Ashrika
    Prakash, K. N. Bhanu
    Kulkarni, Viraj
    Pant, Aniruddha
    [J]. MEDICAL IMAGE UNDERSTANDING AND ANALYSIS (MIUA 2021), 2021, 12722 : 457 - 471
  • [3] Gu ZS, 2020, Arxiv, DOI arXiv:1807.00969
  • [4] Habibzadeh H, 2020, IEEE INTERNET THINGS, V7, P53, DOI [10.1109/JIOT.2019.2946359, 10.1109/jiot.2019.2946359]
  • [5] Neurosurgeon: Collaborative Intelligence Between the Cloud and Mobile Edge
    Kang, Yiping
    Hauswald, Johann
    Gao, Cao
    Rovinski, Austin
    Mudge, Trevor
    Mars, Jason
    Tang, Lingjia
    [J]. ACM SIGPLAN NOTICES, 2017, 52 (04) : 615 - 629
  • [6] Krizhevsky A, 2009, LEARNING MULTIPLE LA, P5
  • [7] Neely M., 2010, Stochastic Network Optimization With Application to Communication and Queueing Systems, V3
  • [8] Privacy-Aware Edge Computing Based on Adaptive DNN Partitioning
    Shi, Chengshuai
    Chen, Lixing
    Shen, Cong
    Song, Linqi
    Xu, Jie
    [J]. 2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,
  • [9] Thapa C, 2022, Arxiv, DOI arXiv:2004.12088
  • [10] Wu D, 2022, IEEE Internet of Things Journal