Semi-Synchronous Federated Learning Protocol With Dynamic Aggregation in Internet of Vehicles

被引:48
作者
Liang, Feiyuan [1 ]
Yang, Qinglin [1 ]
Liu, Ruiqi [1 ]
Wang, Junbo [1 ,2 ,3 ]
Sato, Kento [4 ]
Guo, Jian [5 ]
机构
[1] Sun Yat Sen Univ, Guangzhou 510275, Guangdong, Peoples R China
[2] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Guangzhou 510275, Guangdong, Peoples R China
[3] Sun Yat Sen Univ, Guangdong Prov Key Lab Intelligent Transportat Sy, Guangzhou 510275, Guangdong, Peoples R China
[4] Riken Kobe Branch, Kobe, Hyogo 3510198, Japan
[5] Xian Univ Finance & Econ, Xian 710064, Shaanxi, Peoples R China
关键词
Protocols; Servers; Computational modeling; Data models; Convergence; Collaborative work; Training; Dynamic aggregation; federated learning; intelligent connected vehicles; Internet of Vehicles; semi-synchronization;
D O I
10.1109/TVT.2022.3148872
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In an Internet of Vehicle (IoV) system, federated learning (FL) is a new approach to process real-time vehicle data in a distributed way, which can improve the driving experience and service quality. However, due to the high mobility and uncertainty of vehicles, the existing federated learning protocols are difficult to meet the full requirements from an IoV system, such as efficient resource allocation, high precision learning, and fast convergence of learning algorithm. To solve the above problems, in this paper, we propose a semi-synchronous federated learning (Semi-SynFed) protocol, to improve the performance of machine learning at Internet of Vehicles. In Semi-SynFed, we first select appropriate nodes to participate the aggregation by its computing capacity, network capacity and learning value of training samples. Meanwhile, the dynamic waiting time technique is designed to adjust the server waiting time at each round dynamically, which makes federated learning process work much more efficient. Finally, a dynamic aggregation scheme is designed to aggregate model parameters in an asynchronous way. To evaluate the reliability of Semi-SynFed, we establish a simulation of IoVs based on the real world data. In the comparative experiments, the results show that the Semi-SynFed outperforms the existing federated learning protocols in terms of convergence speed and resource consumption.
引用
收藏
页码:4677 / 4691
页数:15
相关论文
共 36 条
[1]   FedMCCS: Multicriteria Client Selection Model for Optimal IoT Federated Learning [J].
AbdulRahman, Sawsan ;
Tout, Hanine ;
Mourad, Azzam ;
Talhi, Chamseddine .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (06) :4723-4735
[2]  
[Anonymous], 2019, OPENSTREETMAP
[3]  
Baidu Map OpenGPS, 2018, OPENGPS LOC SERV
[4]   FedSA: A staleness-aware asynchronous Federated Learning algorithm with non-IID data [J].
Chen, Ming ;
Mao, Bingcheng ;
Ma, Tianyi .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 120 :1-12
[5]   Communication-Efficient Federated Deep Learning With Layerwise Asynchronous Model Update and Temporally Weighted Aggregation [J].
Chen, Yang ;
Sun, Xiaoyan ;
Jin, Yaochu .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2020, 31 (10) :4229-4238
[6]   Towards asynchronous federated learning for heterogeneous edge-powered internet of things [J].
Chen, Zheyi ;
Liao, Weixian ;
Hua, Kun ;
Lu, Chao ;
Yu, Wei .
DIGITAL COMMUNICATIONS AND NETWORKS, 2021, 7 (03) :317-326
[7]   Overall performance impairment and crash risk due to distracted driving: A comprehensive analysis using structural equation modelling [J].
Choudhary, Pushpa ;
Pawar, Nishant M. ;
Velaga, Nagendra R. ;
Pawar, Digvijay S. .
TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2020, 74 :120-138
[8]  
Fang AF, 2018, 2018 3RD IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION ENGINEERING (ICITE), P23, DOI 10.1109/ICITE.2018.8492572
[9]   Trajectory Data Driven Transit-Transportation Planning [J].
Guo, Yihan ;
Wang, Shaoyong ;
Zheng, Lin ;
Lu, Mingming .
2017 FIFTH INTERNATIONAL CONFERENCE ON ADVANCED CLOUD AND BIG DATA (CBD), 2017, :380-384
[10]   The ApolloScape Open Dataset for Autonomous Driving and Its Application [J].
Huang, Xinyu ;
Wang, Peng ;
Cheng, Xinjing ;
Zhou, Dingfu ;
Geng, Qichuan ;
Yang, Ruigang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (10) :2702-2719