Communication-Efficient Device Scheduling via Over-the-Air Computation for Federated Learning

被引:5
作者
Jiang, Bingqing [1 ]
Du, Jun [1 ]
Jiang, Chunxiao [2 ]
Shi, Yuanming [3 ]
Han, Zhu [4 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Tsinghua Univ, Tsinghua Space Ctr, Beijing 100084, Peoples R China
[3] ShanghaiTech Univ, Sch Informat Sci & Technol, Shanghai 201210, Peoples R China
[4] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
来源
2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022) | 2022年
关键词
ACCESS;
D O I
10.1109/GLOBECOM48099.2022.10000727
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence (AI) is expected as a revolutionary technology to be widely used in Internet-of-Things (IoT) networks for computationally intensive tasks. However, the traditional centralized training framework imposes large latency, network burdens and high risk of privacy disclosure. As a promising distributed solution, federated learning involves the collaborative model training among edge devices, with the orchestration of a server to carry the capacities of low-latency and privacy preservation for AI-driven networks. To further improve the communication efficiency, over-the-air computation (AirComp) is capable of computing while transmitting data by exploiting the superposition property of wireless channels to harness the interference. However, gradient aggregation suffers from channel distortion induced by channel fading and noise, which may degrade the training performance. Moreover, it is beneficial to schedule the informative edge devices in federated learning under limited energy resources. In this work, we propose a dynamic device scheduling scheme for AirComp enabled federated learning systems. In this scheme, a proper number of qualified edge devices with channel inversion based power control are scheduled to participate the model training, where local updates diversity, channel condition and energy consumption are exploited jointly. Inspired by the Lyapunov drift-plus-penalty method, we formulate the optimization problem to attain the device selection strategy. Simulation results validate that the proposed scheme can achieve a close-to-optimal test accuracy with fast convergence rate, and present good performance of robustness under different channel conditions.
引用
收藏
页码:173 / 178
页数:6
相关论文
共 13 条
[1]   Convergence of Update Aware Device Scheduling for Federated Learning at the Wireless Edge [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz ;
Kulkarni, Sanjeev R. ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (06) :3643-3658
[2]   Machine Learning at the Wireless Edge: Distributed Stochastic Gradient Descent Over-the-Air [J].
Amiri, Mohammad Mohammadi ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 (68) :2155-2169
[3]   Transmission Power Control for Over-the-Air Federated Averaging at Network Edge [J].
Cao, Xiaowen ;
Zhu, Guangxu ;
Xu, Jie ;
Cui, Shuguang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (05) :1571-1586
[4]   A Joint Learning and Communications Framework for Federated Learning Over Wireless Networks [J].
Chen, Mingzhe ;
Yang, Zhaohui ;
Saad, Walid ;
Yin, Changchuan ;
Poor, H. Vincent ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (01) :269-283
[5]  
Du JB, 2023, IEEE SYST J, V17, P928, DOI [10.1109/JSYST.2022.3167901, 10.1109/IECON49645.2022.9968334]
[6]   Machine Learning for 6G Wireless Networks: Carrying Forward Enhanced Bandwidth, Massive Access, and Ultrareliable/Low-Latency Service [J].
Du, Jun ;
Jiang, Chunxiao ;
Wang, Jian ;
Ren, Yong ;
Debbah, Merouane .
IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2020, 15 (04) :122-134
[7]  
McMahan HB, 2017, PR MACH LEARN RES, V54, P1273
[8]   Computation over multiple-access channels [J].
Nazer, Bobak ;
Gastpar, Michael .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (10) :3498-3516
[9]   Dynamic Scheduling for Over-the-Air Federated Edge Learning With Energy Constraints [J].
Sun, Yuxuan ;
Zhou, Sheng ;
Niu, Zhisheng ;
Gunduz, Deniz .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (01) :227-242
[10]   Data-Aware Device Scheduling for Federated Edge Learning [J].
Taik, Afaf ;
Mlika, Zoubeir ;
Cherkaoui, Soumaya .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2022, 8 (01) :408-421