Optimal Transport for UAV D2D Distributed Learning: Example using Federated Learning

被引:8
作者
Azmy, Sherif B. [1 ]
Abutuleb, Amr [1 ]
Sorour, Sameh [2 ]
Zorba, Nizar [3 ]
Hassanein, Hossam S. [2 ]
机构
[1] Queens Univ, Dept Elect & Comp Engn, Kingston, ON, Canada
[2] Queens Univ, Sch Comp, Kingston, ON, Canada
[3] Qatar Univ, Elect Engn Dept, Doha, Qatar
来源
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021) | 2021年
基金
加拿大自然科学与工程研究理事会;
关键词
Distributed Learning; Federated Learning; Optimal Transport; Flying Ad-Hoc Networks; Unmanned Aerial Vehicles; Mobile Edge Computing; NETWORKS;
D O I
10.1109/ICC42927.2021.9500304
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Federated Learning (FL) is a novel distributed learning paradigm in which local learning models are simultaneously trained using the stored data on multiple devices, then ultimately aggregated into a global model. A promising use case of FL is the training of a global model using the data collected by unmanned aerial vehicles (UAVs) during their flight, which is invaluable in scenarios in which an infrastructure cannot be accessed (e.g., disaster). However, this is challenging as limited resources are to be distributed between flight time, sensing, processing, and communication. In this paper, we address the resource problem for a set of heterogeneous UAVs with different computation and communication capabilities from distributed point of view. We propose the usage of Device-to-Device (D2D) communication to fairly distribute the data so-far collected by UAVs with different capabilities by posing it as an optimal transport problem. Our contribution is two-fold: (1) We obtain the fairest distribution of data given the UAVs' computational capabilities such that global learning time is minimal; (2) We devise a scheme using Optimal Transport (OT) to achieve such a fair distribution between UAVs. The performance of the proposed techniques is demonstrated in an FL setting with different UAV topologies with the FL training done using the MNIST dataset.
引用
收藏
页数:6
相关论文
共 16 条
[1]  
Azmy S. B., 2019, IEEE WCNC, P1
[2]  
Cai X., 2020, D2D ENABLED DATA SHA
[3]   Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices [J].
Chen, Yu-Hsin ;
Yange, Tien-Ju ;
Emer, Joel S. ;
Sze, Vivienne .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (02) :292-308
[4]  
Howard A. G., MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, DOI DOI 10.48550/ARXIV.1704.04861
[5]  
Kairouz P, 2019, CoRR abs/ 1912.04977
[6]   TOWARD FUTURE UNMANNED AERIAL VEHICLE NETWORKS: ARCHITECTURE, RESOURCE ALLOCATION AND FIELD EXPERIMENTS [J].
Kawamoto, Yuichi ;
Nishiyama, Hiroki ;
Kato, Nei ;
Ono, Fumie ;
Miura, Ryu .
IEEE WIRELESS COMMUNICATIONS, 2019, 26 (01) :94-99
[7]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[8]  
Lu YX, 2018, IEEE INT C INT ROBOT, P2566, DOI 10.1109/IROS.2018.8594163
[9]   Deep Learning for IoT Big Data and Streaming Analytics: A Survey [J].
Mohammadi, Mehdi ;
Al-Fuqaha, Ala ;
Sorour, Sameh ;
Guizani, Mohsen .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2018, 20 (04) :2923-2960
[10]  
Mohammed F, 2014, INT CONF UNMAN AIRCR, P267, DOI 10.1109/ICUAS.2014.6842265