Incentivize to Build: A Crowdsourcing Framework for Federated Learning

被引:16
作者
Pandey, Shashi Raj [1 ]
Tran, Nguyen H. [2 ]
Bennis, Mehdi [1 ,3 ]
Tun, Yan Kyaw [1 ]
Han, Zhu [1 ,4 ]
Hong, Choong Seon [1 ]
机构
[1] Kyung Hee Univ, Dept Comp Sci & Engn, Seoul 17104, South Korea
[2] Univ Sydney, Sch Comp Sci, Sydney, NSW 2006, Australia
[3] Univ Oulu, Ctr Wireless Commun, Oulu 90014, Finland
[4] Univ Houston, Dept Elect & Comp Engn, Houston, TX 77004 USA
来源
2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM) | 2019年
关键词
Decentralized machine learning; federated learning; mobile crowdsourcing; stackelberg game;
D O I
10.1109/globecom38437.2019.9014329
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated learning (FL) rests on the notion of training a global model in a decentralized manner. Under this setting, mobile devices perform computations on their local data before uploading the required updates to the central aggregator for improving the global model. However, a key challenge is to maintain communication efficiency (i.e., the number of communications per iteration) when participating clients implement uncoordinated computation strategy during aggregation of model parameters. We formulate a utility maximization problem to tackle this difficulty, and propose a novel crowdsourcing framework, involving a number of participating clients with local training data to leverage FL. We show the incentive-based interaction between the crowdsourcing platform and the participating client's independent strategies for training a global learning model, where each side maximizes its own benefit. We formulate a two -stage Stackelberg game to analyze such scenario and find the game's equilibria. Further, we illustrate the efficacy of our proposed framework with simulation results. Results show that the proposed mechanism outperforms the heuristic approach with up to 22% gain in the offered reward to attain a level of target accuracy.
引用
收藏
页数:6
相关论文
共 12 条
  • [1] [Anonymous], ARXIV180100936
  • [2] [Anonymous], 2017, GOOGLE RES BLOG APR
  • [3] Baumgarten N, 2012, STUD PRAGMAT, P1
  • [4] Mobile Crowdsensing: Current State and Future Challenges
    Ganti, Raghu K.
    Ye, Fan
    Lei, Hui
    [J]. IEEE COMMUNICATIONS MAGAZINE, 2011, 49 (11) : 32 - 39
  • [5] Kim Hyesung, 2018, ARXIV180803949
  • [6] Konecny J., 2016, FEDERATED OPTIMIZATI
  • [7] Konecny J., 2016, NIPS WORKSH PRIV MUL
  • [8] Semi-stochastic coordinate descent
    Konecny, Jakub
    Qu, Zheng
    Richtarik, Peter
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (05) : 993 - 1005
  • [9] Distributed optimization with arbitrary local solvers
    Ma, Chenxin
    Konecny, Jakub
    Jaggi, Martin
    Smith, Virginia
    Jordan, Michael I.
    Richtarik, Peter
    Takac, Martin
    [J]. OPTIMIZATION METHODS & SOFTWARE, 2017, 32 (04) : 813 - 848
  • [10] McMahan H. B., 2016, arXiv preprint arXiv:1602.05629 2