A Novel Joint Dataset and Incentive Management Mechanism for Federated Learning Over MEC

被引:8
作者
Lee, Joohyung [1 ]
Kim, Daejin [2 ]
Niyato, Dusit [3 ]
机构
[1] Gachon Univ, Sch Comp, Seongnam 13120, South Korea
[2] Samsung Elect, Suwon 16677, South Korea
[3] Nanyang Technol Univ, Sch Comp Sci & Engn SCSE, Singapore 639798, Singapore
基金
新加坡国家研究基金会;
关键词
Games; Resource management; Energy consumption; Training; Computational modeling; Servers; Analytical models; Federated learning; incentive mechanism; machine learning; Stackelberg game; NETWORKS; OPTIMIZATION; ALLOCATION; INTERNET;
D O I
10.1109/ACCESS.2022.3156045
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, to reduce the energy consumption for the federated learning (FL) participation of mobile devices (MDs), we design a novel joint dataset and incentive management mechanism for FL over mobile edge computing (MEC) systems. We formulate a Stackelberg game to model and analyze the behaviors of FL participants, referred to as MDs, and FL service providers, referred to as MECs. In the proposed game, each MEC is the leader, whereas the MDs are followers. As the leader, to maximize its own revenue by considering the trade-off between the cost of providing incentives and the estimated accuracy attained from an FL operation, each MEC provides full incentives to the MDs for the participation of each FL task, as well as the target accuracy level for each MD. The suggested total incentives are allocated over MDs' proportion to the amount of dataset applied for local training, which indirectly affects the global accuracy of the FL. Based on the suggested incentives, the MDs determine the amount of dataset used for the local training of each FL task to maximize their own payoffs, which is defined as the energy consumed from FL participation and the expected incentives. We study the economic benefits of the joint dataset and incentive management mechanism by analyzing its hierarchical decision-making scheme as a multi-leader multi-follower Stackelberg game. Using backward induction, we prove the existence and uniqueness of the Nash equilibrium among MDs, and then examine the Stackelberg equilibrium by analyzing the leader game. We also discuss extensions of the proposed mechanism where the MDs are unaware of explicit information of other MD profiles, such as the weights of the revenue as a practical concern, which can be redesigned into the Stackelberg Bayesian game. Finally, we reveal that the Stackelberg equilibrium solution maximizes the utility of all MDs and the MECs.
引用
收藏
页码:30026 / 30038
页数:13
相关论文
共 28 条
[11]   Market Analysis of Distributed Learning Resource Management for Internet of Things: A Game-Theoretic Approach [J].
Lee, Joohyung ;
Kim, DaeJin ;
Niyato, Dusit .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (09) :8430-8439
[12]   Distributed Energy Trading in Microgrids: A Game-Theoretic Model and Its Equilibrium Analysis [J].
Lee, Joohyung ;
Guo, Jun ;
Choi, Jun Kyun ;
Zukerman, Moshe .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (06) :3524-3533
[13]   Federated Learning: Challenges, Methods, and Future Directions [J].
Li, Tian ;
Sahu, Anit Kumar ;
Talwalkar, Ameet ;
Smith, Virginia .
IEEE SIGNAL PROCESSING MAGAZINE, 2020, 37 (03) :50-60
[14]   Federated Learning in Mobile Edge Networks: A Comprehensive Survey [J].
Lim, Wei Yang Bryan ;
Nguyen Cong Luong ;
Dinh Thai Hoang ;
Jiao, Yutao ;
Liang, Ying-Chang ;
Yang, Qiang ;
Niyato, Dusit ;
Miao, Chunyan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2020, 22 (03) :2031-2063
[15]  
Lin J., 2019, ARXIV191112560, P1
[16]   HFEL: Joint Edge Association and Resource Allocation for Cost-Efficient Hierarchical Federated Edge Learning [J].
Luo, Siqi ;
Chen, Xu ;
Wu, Qiong ;
Zhou, Zhi ;
Yu, Shuai .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (10) :6535-6548
[17]   Stackelberg Bayesian Game for Power Allocation in Two-Tier Networks [J].
Nguyen Duy Duong ;
Madhukumar, A. S. ;
Niyato, Dusit .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2016, 65 (04) :2341-2354
[18]  
Nishio T, 2019, IEEE ICC
[19]  
Osborne M.J., 1994, A Course in Game Theory
[20]   Incentivize to Build: A Crowdsourcing Framework for Federated Learning [J].
Pandey, Shashi Raj ;
Tran, Nguyen H. ;
Bennis, Mehdi ;
Tun, Yan Kyaw ;
Han, Zhu ;
Hong, Choong Seon .
2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,