Dual Model Pruning Enables Efficient Federated Learning in Intelligent Transportation Systems

被引:0
作者
Pei, Jiaming [1 ]
Li, Wei [1 ]
机构
[1] Univ Sydney, Sch Comp Sci, Sydney, NSW 2006, Australia
基金
澳大利亚研究理事会;
关键词
Neurons; Federated learning; Filters; Computational modeling; Training; Servers; Mutual information; neural network pruning; intelligent transportation system;
D O I
10.1109/TITS.2024.3453955
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Federated learning significantly enhances intelligent transportation systems by enabling collaborative model training across multiple clients, thereby improving overall performance. However, the involvement of multiple participants, each using oversized models for local data processing, leads to substantial communication volumes and reduced communication efficiency. To address this issue, we propose the Federated Client and Global (FEDCG) pruning method, employing a two-stage pruning strategy at both the client and server levels. This approach uses mutual information to assess the importance of individual neurons or filters within a neural network, allowing for global pruning on the server. Specifically, federated learning connects multiple sub-models within intelligent transportation systems, such as autonomous vehicles and vehicle detection models, by reducing redundant parameters through pruning. When handling differences between various models, we use a parameter aggregation strategy to ensure the effectiveness of the global model. Our method first performs preliminary pruning at the client side to reduce local communication overhead, followed by further pruning at the server side to aggregate effective parameters from each client into a global model. This global model is constructed based on the pruned client models to ensure efficiency and accuracy. Extensive experiments demonstrate that FEDCG effectively reduces communication overheads during both the uploading and downloading phases while maintaining high accuracy and robustness across various datasets and neural network architectures. This method provides a valuable tool for practical federated learning in intelligent transportation systems.
引用
收藏
页数:12
相关论文
共 44 条
[41]  
Zeng D., 2023, Journal of Machine Learning Research, V24, P1
[42]   Federated Representation Learning With Data Heterogeneity for Human Mobility Prediction [J].
Zhang, Xiao ;
Wang, Qilin ;
Ye, Ziming ;
Ying, Haochao ;
Yu, Dongxiao .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) :6111-6122
[43]   Toward Robust Hierarchical Federated Learning in Internet of Vehicles [J].
Zhou, Hongliang ;
Zheng, Yifeng ;
Huang, Hejiao ;
Shu, Jiangang ;
Jia, Xiaohua .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (05) :5600-5614
[44]  
Zhu R., 2023, IEEE Trans. Intell. Transp. Syst., V24, P1