Federated Learning Based on Mutual Information Clustering for Wireless Traffic Prediction

被引:3
作者
Zhang, Jianwei [1 ,2 ]
Hu, Xinhua [1 ]
Cai, Zengyu [3 ]
Zhu, Liang [3 ]
Feng, Yuan [3 ]
机构
[1] Zhengzhou Univ Light Ind, Sch Software Engn, Zhengzhou 450001, Peoples R China
[2] ZZULI Res Inst Ind Technol, Zhengzhou 450001, Peoples R China
[3] Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450001, Peoples R China
基金
中国国家自然科学基金;
关键词
wireless traffic prediction; federated learning; mutual information; attention aggregation;
D O I
10.3390/electronics12214476
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless traffic prediction can help operators accurately predict the usage of wireless networks, and it plays an important role in the load balancing and energy saving of base stations. Currently, most traffic prediction methods are centralized learning strategies, which need to transmit a large amount of traffic data and have timeliness and data privacy issues. Federated learning, as a distributed learning framework with no client data sharing and multi-client collaborative training, can solve such problems. We propose a federated learning wireless traffic prediction framework based on mutual information clustering (FedMIC). First, a sliding window scheme is used to construct the raw data into adjacent and periodic dual-traffic sequences and capture their traffic characteristics separately to enhance the client model learning capability. Second, clients with similar traffic data distributions are clustered together using a mutual information-based spectral clustering algorithm to facilitate the capture of the personalized features of each clustered model. Then, models are aggregated using a hierarchical aggregation architecture of intra-cluster model aggregation and inter-cluster model aggregation to address the statistical heterogeneity challenge of federated learning and to improve the prediction accuracy of models. Finally, an attention mechanism-based model aggregation algorithm is used to improve the generalization ability of the global model. Experimental results show that our proposed method minimizes the prediction error and has superior traffic prediction performance compared to traditional distributed machine learning methods and other federated learning methods.
引用
收藏
页数:16
相关论文
共 34 条
[1]   Large-scale Network Traffic Prediction With LSTM and Temporal Convolutional Networks [J].
Bi, Jing ;
Yuan, Haitao ;
Xu, Kangyuan ;
Ma, Haisen ;
Zhou, Mengchu .
2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, :3865-3870
[2]   Cluster-driven Graph Federated Learning over Multiple Domains [J].
Caldarola, Debora ;
Mancini, Massimiliano ;
Galasso, Fabio ;
Ciccone, Marco ;
Rodola, Emanuele ;
Caputo, Barbara .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2021, 2021, :2743-2752
[3]   Mutual information based input feature selection for classification problems [J].
Cang, Shuang ;
Yu, Hongnian .
DECISION SUPPORT SYSTEMS, 2012, 54 (01) :691-698
[4]   A mutual information based federated learning framework for edge computing networks [J].
Chen, Naiyue ;
Li, Yinglong ;
Liu, Xuejun ;
Zhang, Zhenjiang .
COMPUTER COMMUNICATIONS, 2021, 176 (176) :23-30
[5]  
Feng HF, 2006, IEEE ICC, P597
[6]   An Efficient Framework for Clustered Federated Learning [J].
Ghosh, Avishek ;
Chung, Jichan ;
Yin, Dong ;
Ramchandran, Kannan .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2022, 68 (12) :8076-8091
[7]  
Ji SX, 2019, IEEE IJCNN, DOI 10.1109/ijcnn.2019.8852464
[8]   Cellular traffic prediction with machine learning: A survey [J].
Jiang, Weiwei .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 201
[9]  
Jianyong Fan, 2019, 2019 2nd International Conference on Information Systems and Computer Aided Education (ICISCAE), P554, DOI 10.1109/ICISCAE48440.2019.221694
[10]  
Kornblith S, 2019, PR MACH LEARN RES, V97