A Hierarchical Incentive Mechanism for Coded Federated Learning

被引:1
作者
Ng, Jer Shyuan [1 ,2 ]
Lim, Wei Yang Bryan [1 ,2 ]
Xiong, Zehui [3 ]
Deng, Xianjun [4 ]
Zhang, Yang [5 ]
Niyato, Dusit [6 ]
Leung, Cyril [7 ,8 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
[2] Alibaba NTU JRI, Singapore, Singapore
[3] Singapore Univ Technol Design, Singapore, Singapore
[4] Huazhong Univ Sci & Technol, Wuhan, Peoples R China
[5] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[6] Nanyang Technol Univ, SCSE, Singapore, Singapore
[7] Nanyang Technol Univ, LILY Res Ctr, Singapore, Singapore
[8] Univ British Columbia, ECE, Vancouver, BC, Canada
来源
2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021) | 2021年
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Coded distributed computing; Federated Learning; Straggler effects; Evolutionary; Deep learning; Auction; SERVICE SELECTION;
D O I
10.1109/MSN53354.2021.00019
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) is a privacy-preserving collaborative learning approach that trains artificial intelligence (AI) models without revealing local datasets of the FL workers. One of the main challenges is the straggler effects where the significant computation delays are caused by the slow FL workers. As such, Coded Federated Learning (CFL), which leverages coding techniques to introduce redundant computations to the FL server, has been proposed to reduce the computation latency. In order to implement the coding schemes over the FL network, incentive mechanisms are important to allocate the resources of the FL workers and data owners efficiently in order to complete the CFL training tasks. In this paper, we consider a two-level incentive mechanism design problem. In the lower level, the data owners are allowed to support the FL training tasks of the FL workers by contributing their data. To model the dynamics of the selection of FL workers by the data owners, an evolutionary game is adopted to achieve an equilibrium solution. In the upper level, a deep learning based auction is proposed to model the competition among the model owners.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 17 条
[1]   Coded Federated Learning [J].
Dhakal, Sagar ;
Prakash, Saurav ;
Yona, Yair ;
Talwar, Shilpa ;
Himayat, Nageen .
2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
[2]   The Algorithmic Foundations of Differential Privacy [J].
Dwork, Cynthia ;
Roth, Aaron .
FOUNDATIONS AND TRENDS IN THEORETICAL COMPUTER SCIENCE, 2013, 9 (3-4) :211-406
[3]   Dynamic Access Point and Service Selection in Backscatter-Assisted RF-Powered Cognitive Networks [J].
Gao, Xiaozheng ;
Feng, Shaohan ;
Niyato, Dusit ;
Wang, Ping ;
Yang, Kai ;
Liang, Ying-Chang .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (05) :8270-8283
[4]   Evolutionary game dynamics [J].
Hofbauer, J ;
Sigmund, K .
BULLETIN OF THE AMERICAN MATHEMATICAL SOCIETY, 2003, 40 (04) :479-519
[5]  
Lim, 2021, IEEE T INTELL TRANSP, V22, P1
[6]   Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks [J].
Lim, Wei Yang Bryan ;
Xiong, Zehui ;
Miao, Chunyan ;
Niyato, Dusit ;
Yang, Qiang ;
Leung, Cyril ;
Poor, H. Vincent .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) :9575-9588
[7]   Dynamic Resource Allocation for Hierarchical Federated Learning [J].
Lim, Wei Yang Bryan ;
Ng, Jer Shyuan ;
Xiong, Zehui ;
Niyato, Dusit ;
Guo, Song ;
Leung, Cyril ;
Miao, Chunyan .
2020 16TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2020), 2020, :153-160
[8]   Federated Learning in Mobile Edge Networks: A Comprehensive Survey [J].
Lim, Wei Yang Bryan ;
Nguyen Cong Luong ;
Dinh Thai Hoang ;
Jiao, Yutao ;
Liang, Ying-Chang ;
Yang, Qiang ;
Niyato, Dusit ;
Miao, Chunyan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (03) :2031-2063
[9]  
Luong NC, 2018, IEEE ICC
[10]   Dynamics of Network Selection in Heterogeneous Wireless Networks: An Evolutionary Game Approach [J].
Niyato, Dusit ;
Hossain, Ekram .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2009, 58 (04) :2008-2017