Federated Learning Based on Mutual Information Clustering for Wireless Traffic Prediction

被引:3
作者
Zhang, Jianwei [1 ,2 ]
Hu, Xinhua [1 ]
Cai, Zengyu [3 ]
Zhu, Liang [3 ]
Feng, Yuan [3 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Software Engn, Zhengzhou 450001, Peoples R China
[2] ZZULI Res Inst Ind Technol, Zhengzhou 450001, Peoples R China
[3] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
wireless traffic prediction; federated learning; mutual information; attention aggregation;
D O I
10.3390/electronics12214476
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless traffic prediction can help operators accurately predict the usage of wireless networks, and it plays an important role in the load balancing and energy saving of base stations. Currently, most traffic prediction methods are centralized learning strategies, which need to transmit a large amount of traffic data and have timeliness and data privacy issues. Federated learning, as a distributed learning framework with no client data sharing and multi-client collaborative training, can solve such problems. We propose a federated learning wireless traffic prediction framework based on mutual information clustering (FedMIC). First, a sliding window scheme is used to construct the raw data into adjacent and periodic dual-traffic sequences and capture their traffic characteristics separately to enhance the client model learning capability. Second, clients with similar traffic data distributions are clustered together using a mutual information-based spectral clustering algorithm to facilitate the capture of the personalized features of each clustered model. Then, models are aggregated using a hierarchical aggregation architecture of intra-cluster model aggregation and inter-cluster model aggregation to address the statistical heterogeneity challenge of federated learning and to improve the prediction accuracy of models. Finally, an attention mechanism-based model aggregation algorithm is used to improve the generalization ability of the global model. Experimental results show that our proposed method minimizes the prediction error and has superior traffic prediction performance compared to traditional distributed machine learning methods and other federated learning methods.
引用
收藏
页数:16
相关论文
共 34 条
[21]  
Nie LS, 2017, IEEE WCNC
[22]   Network Traffic Prediction Using Recurrent Neural Networks [J].
Ramakrishnan, Nipun ;
Soni, Tarun .
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, :187-193
[23]   Clustered Federated Learning: Model-Agnostic Distributed Multitask Optimization Under Privacy Constraints [J].
Sattler, Felix ;
Mueller, Klaus-Robert ;
Samek, Wojciech .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (08) :3710-3722
[24]   Mutual Information Driven Federated Learning [J].
Uddin, Md Palash ;
Xiang, Yong ;
Lu, Xuequan ;
Yearwood, John ;
Gao, Longxiang .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2021, 32 (07) :1526-1538
[25]   Traffic Prediction in Optical Networks Using Graph Convolutional Generative Adversarial Networks [J].
Vinchoff, C. ;
Chung, N. ;
Gordon, T. ;
Lyford, L. ;
Aibin, M. .
2020 22ND INTERNATIONAL CONFERENCE ON TRANSPARENT OPTICAL NETWORKS (ICTON 2020), 2020,
[26]  
Wang Jianyu, 2020, ADV NEURAL INFORM PR, V33
[27]   A network traffic forecasting method based on SA optimized ARIMA-BP neural network [J].
Yang, Hanyu ;
Li, Xutao ;
Qiang, Wenhao ;
Zhao, Yuhan ;
Zhang, Wei ;
Tang, Chang .
COMPUTER NETWORKS, 2021, 193
[28]   Federated Machine Learning: Concept and Applications [J].
Yang, Qiang ;
Liu, Yang ;
Chen, Tianjian ;
Tong, Yongxin .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (02)
[29]   Artificial Intelligence Defined 5G Radio Access Networks [J].
Yao, Miao ;
Sohul, Munawwar ;
Marojevic, Vuk ;
Reed, Jeffrey H. .
IEEE COMMUNICATIONS MAGAZINE, 2019, 57 (03) :14-20
[30]   Dual Attention-Based Federated Learning for Wireless Traffic Prediction [J].
Zhang, Chuanting ;
Dang, Shuping ;
Shihada, Basem ;
Alouini, Mohamed-Slim .
IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2021), 2021,