FedAPT: Joint Adaptive Parameter Freezing and Resource Allocation for Communication-Efficient Federated Vehicular Networks

被引:10
作者
Wu, Jia [1 ,2 ]
Dai, Tingyi [1 ]
Guan, Peiyuan [3 ]
Liu, Su [4 ]
Gou, Fangfang [1 ]
Taherkordi, Amir [3 ]
Li, Yushuai [5 ]
Li, Tianyi [5 ]
机构
[1] Guizhou Univ, Sch Comp Sci & Technol, Guiyang 550025, Peoples R China
[2] Monash Univ, Fac IT, Res Ctr Artificial Intelligence, Melbourne, Vic 3800, Australia
[3] Univ Oslo, Dept Informat, N-0316 Oslo, Norway
[4] Xinjiang Univ, Sch Informat Sci & Engn, Urumqi 830046, Peoples R China
[5] Aalborg Univ, Dept Comp Sci, DK-9220 Aalborg, Denmark
基金
欧盟地平线“2020”;
关键词
Servers; Data models; Resource management; Training; Bandwidth; Particle swarm optimization; Federated learning; Communication efficiency; federated learning (FL); parameter freezing; particle swarm optimization (PSO); transformer; OPTIMIZATION;
D O I
10.1109/JIOT.2024.3367946
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Telematics technology development offers vehicles a range of intelligent and convenient functions, including navigation and mapping services, intelligent driving assistance, and intelligent traffic management. However, since these functions deal with sensitive information like vehicle location and driving habits, it is crucial to address concerns regarding information security and privacy protection. Federated learning (FL) is highly suitable for addressing such problems due to its characteristics, in which a client does not need to share private data and upload model parameters to a parameter server (PS) via the network. This results in the establishment of a federated vehicle network (FVN). As a distributed paradigm, the efficiency of communication is crucial in FL as it impacts all aspects of the FVN. This article introduces a parameter freezing algorithm based on historical information to reduce the data transferred between the client and the PS in each round of communication, thus minimizing the communication overhead of FL. Additionally, we propose using a particle swarm algorithm to allocate network bandwidth to each vehicle based on the packet sizes sent by each vehicle (i.e., the nonfreezing parameters) to minimize the communication latency in each FL round. Furthermore, due to the high time complexity of the particle swarm algorithm, we employ it to generate training data for training a transformer model with fast response and sufficient accuracy, thereby accelerating the bandwidth allocation process. Through extensive experiments, we prove the feasibility of our approach and its efficiency in improving communication in FL.
引用
收藏
页码:19520 / 19536
页数:17
相关论文
共 42 条
[1]   Energy-Efficient Resource Allocation for Federated Learning in NOMA-Enabled and Relay-Assisted Internet of Things Networks [J].
Al-Abiad, Mohammed S. ;
Hassan, Md. Zoheb ;
Hossain, Md. Jahangir .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (24) :24736-24753
[2]   DSFL: Dynamic Sparsification for Federated Learning [J].
Beitollahi, Mahdi ;
Liu, Mingrui ;
Lu, Ning .
2022 5TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS, SIGNAL PROCESSING, AND THEIR APPLICATIONS (ICCSPA), 2022,
[3]   Electrification of the two-car household: PHEV or BEV? [J].
Bjornsson, Lars-Henrik ;
Karlsson, Sten .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2017, 85 :363-376
[4]  
Brock A, 2017, Arxiv, DOI arXiv:1706.04983
[5]  
Caldas S, 2019, Arxiv, DOI arXiv:1812.07210
[6]   Synchronize Only the Immature Parameters: Communication-Efficient Federated Learning By Freezing Parameters Adaptively [J].
Chen, Chen ;
Xu, Hong ;
Wang, Wei ;
Li, Baochun ;
Li, Bo ;
Chen, Li ;
Zhang, Gong .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2024, 35 (07) :1155-1173
[7]   Communication-Efficient Federated Learning with Adaptive Parameter Freezing [J].
Chen, Chen ;
Xu, Hong ;
Wang, Wei ;
Li, Baochun ;
Li, Bo ;
Chen, Li ;
Zhang, Gong .
2021 IEEE 41ST INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS 2021), 2021, :1-11
[8]   Convergence Time Optimization for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Poor, H. Vincent ;
Saad, Walid ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (04) :2457-2471
[9]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[10]   Federated Echo State Learning for Minimizing Breaks in Presence in Wireless Virtual Reality Networks [J].
Chen, Mingzhe ;
Semiari, Omid ;
Saad, Walid ;
Liu, Xuanlin ;
Yin, Changchuan .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) :177-191