Optimization Design for Federated Learning in Heterogeneous 6G Networks

被引:6
作者
Luo, Bing [1 ]
Han, Pengchao [4 ,5 ]
Sun, Peng [3 ]
Ouyang, Xiaomin [2 ]
Huang, Jianwei [4 ,5 ]
Ding, Ningning [6 ]
机构
[1] Duke Kunshan Univ, Suzhou, Peoples R China
[2] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[3] Hunan Univ, Changsha 410082, Hunan, Peoples R China
[4] Chinese Univ Hong Kong, Hong Kong, Peoples R China
[5] Shenzhen Inst Artificial Intelligence & Robot Soc, Shenzhen, Peoples R China
[6] Northwestern Univ, Evanston, IL USA
来源
IEEE NETWORK | 2023年 / 37卷 / 02期
基金
中国国家自然科学基金;
关键词
6G mobile communication; Human computer interaction; Data centers; Federated learning; Training data; Prototypes; Network resource management; 5G mobile communication; Internet of Things; Heterogeneous networks;
D O I
10.1109/MNET.006.2200437
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With the rapid advancement of 5G networks, billions of smart Internet of Things (IoT) devices along with an enormous amount of data are generated at the network edge. While still at an early age, it is expected that the evolving 6G network will adopt advanced artificial intelligence (AI) technologies to collect, transmit, and learn this valuable data for innovative applications and intelligent services. However, traditional machine learning (ML) approaches require centralizing the training data in the data center or cloud, raising serious user-privacy concerns. Federated learning, as an emerging distributed AI paradigm with privacy-preserving nature, is anticipated to be a key enabler for achieving ubiquitous AI in 6G networks. However, there are several system and statistical heterogeneity challenges for effective and efficient FL implementation in 6G networks. In this article, we investigate the optimization approaches that can effectively address the challenging heterogeneity issues from three aspects: incentive mechanism design, network resource management, and personalized model optimization. We also present some open problems and promising directions for future research.
引用
收藏
页码:38 / 43
页数:6
相关论文
共 15 条
  • [1] Optimal Contract Design for Efficient Federated Learning With Multi-Dimensional Private Information
    Ding, Ningning
    Fang, Zhixuan
    Huang, Jianwei
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (01) : 186 - 200
  • [2] Dinh C. T, 2020, Advances in Neural Information Processing Systems, V33, P394
  • [3] Adaptive Gradient Sparsification for Efficient Federated Learning: An Online Learning Approach
    Han, Pengchao
    Wang, Shiqiang
    Leung, Kin K.
    [J]. 2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, : 300 - 310
  • [4] Li T., 2020, PROC MACH LEARN SYST, P429, DOI DOI 10.48550/ARXIV.1812.06127
  • [5] Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Sampling
    Luo, Bing
    Xiao, Wenli
    Wang, Shiqiang
    Huang, Jianwei
    Tassiulas, Leandros
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, : 1739 - 1748
  • [6] Cost-Effective Federated Learning in Mobile Edge Networks
    Luo, Bing
    Li, Xiang
    Wang, Shiqiang
    Huang, Jianwei
    Tassiulas, Leandros
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3606 - 3621
  • [7] McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
  • [8] Profit-Maximizing Model Marketplace with Differentially Private Federated Learning
    Sun, Peng
    Chen, Xu
    Liao, Guocheng
    Huang, Jianwei
    [J]. IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, : 1439 - 1448
  • [9] Pain-FL: Personalized Privacy-Preserving Incentive for Federated Learning
    Sun, Peng
    Che, Haoxuan
    Wang, Zhibo
    Wang, Yuwei
    Wang, Tao
    Wu, Liantao
    Shao, Huajie
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2021, 39 (12) : 3805 - 3820
  • [10] When Machine Learning Meets Privacy in 6G: A Survey
    Sun, Yuanyuan
    Liu, Jiajia
    Wang, Jiadai
    Cao, Yurui
    Kato, Nei
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (04): : 2694 - 2724