A Hierarchical Incentive Mechanism for Coded Federated Learning

被引:0
|
作者
Ng, Jer Shyuan [1 ,2 ]
Lim, Wei Yang Bryan [1 ,2 ]
Xiong, Zehui [3 ]
Deng, Xianjun [4 ]
Zhang, Yang [5 ]
Niyato, Dusit [6 ]
Leung, Cyril [7 ,8 ]
机构
[1] Alibaba Grp, Hangzhou, Peoples R China
[2] Alibaba NTU JRI, Singapore, Singapore
[3] Singapore Univ Technol Design, Singapore, Singapore
[4] Huazhong Univ Sci & Technol, Wuhan, Peoples R China
[5] Nanjing Univ Aeronaut & Astronaut, Nanjing, Peoples R China
[6] Nanyang Technol Univ, SCSE, Singapore, Singapore
[7] Nanyang Technol Univ, LILY Res Ctr, Singapore, Singapore
[8] Univ British Columbia, ECE, Vancouver, BC, Canada
来源
2021 17TH INTERNATIONAL CONFERENCE ON MOBILITY, SENSING AND NETWORKING (MSN 2021) | 2021年
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
Coded distributed computing; Federated Learning; Straggler effects; Evolutionary; Deep learning; Auction; SERVICE SELECTION;
D O I
10.1109/MSN53354.2021.00019
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) is a privacy-preserving collaborative learning approach that trains artificial intelligence (AI) models without revealing local datasets of the FL workers. One of the main challenges is the straggler effects where the significant computation delays are caused by the slow FL workers. As such, Coded Federated Learning (CFL), which leverages coding techniques to introduce redundant computations to the FL server, has been proposed to reduce the computation latency. In order to implement the coding schemes over the FL network, incentive mechanisms are important to allocate the resources of the FL workers and data owners efficiently in order to complete the CFL training tasks. In this paper, we consider a two-level incentive mechanism design problem. In the lower level, the data owners are allowed to support the FL training tasks of the FL workers by contributing their data. To model the dynamics of the selection of FL workers by the data owners, an evolutionary game is adopted to achieve an equilibrium solution. In the upper level, a deep learning based auction is proposed to model the competition among the model owners.
引用
收藏
页码:17 / 24
页数:8
相关论文
共 50 条
  • [1] A Hierarchical Incentive Mechanism for Federated Learning
    Huang, Jiwei
    Ma, Bowen
    Wu, Yuan
    Chen, Ying
    Shen, Xuemin
    IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (12) : 12731 - 12747
  • [2] A Hierarchical Incentive Design Toward Motivating Participation in Coded Federated Learning
    Ng, Jer Shyuan
    Lim, Wei Yang Bryan
    Xiong, Zehui
    Cao, Xianbin
    Niyato, Dusit
    Leung, Cyril
    Kim, Dong In
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2022, 40 (01) : 359 - 375
  • [3] Stochastic Coded Federated Learning: Theoretical Analysis and Incentive Mechanism Design
    Sun, Yuchang
    Shao, Jiawei
    Mao, Yuyi
    Li, Songze
    Zhang, Jun
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (06) : 6623 - 6638
  • [4] Incentive Mechanism for AI-Based Mobile Applications with Coded Federated Learning
    Saputra, Yuris Mulya
    Nguyen, Diep N.
    Dinh Thai Hoang
    Dutkiewicz, Eryk
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [5] Users Collaborative Computing for Hierarchical Federated Learning Based on Incentive Mechanism
    Zhuang, Bei
    Lin, Shangjing
    Li, Yueying
    Ma, Ji
    Tian, Jin
    Zhang, Chunhong
    Hu, Zheng
    IOT AS A SERVICE, IOTAAS 2023, 2025, 585 : 239 - 254
  • [6] Hierarchical Incentive Mechanism Design for Federated Machine Learning in Mobile Networks
    Lim, Wei Yang Bryan
    Xiong, Zehui
    Miao, Chunyan
    Niyato, Dusit
    Yang, Qiang
    Leung, Cyril
    Poor, H. Vincent
    IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (10) : 9575 - 9588
  • [7] A hierarchical federated learning incentive mechanism in UAV-assisted edge computing environment
    He, Guangxuan
    Li, Chunlin
    Song, Mingyang
    Shu, Yong
    Lu, Chengwei
    Luo, Youlong
    AD HOC NETWORKS, 2023, 149
  • [8] Contribution Matching-Based Hierarchical Incentive Mechanism Design for Crowd Federated Learning
    Zhang, Hangjian
    Jin, Yanan
    Lu, Jianfeng
    Cao, Shuqin
    Dai, Qing
    Yang, Shasha
    IEEE ACCESS, 2024, 12 : 24735 - 24750
  • [9] Research on Hierarchical Federated Learning Incentive Mechanism Based on Master-Slave Game
    Jia, Yunjian
    Huang, Yu
    Liang, Liang
    Wan, Yangliang
    Zhou, Jihua
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (04) : 1366 - 1373
  • [10] A multi-dimensional incentive mechanism based on age of update in hierarchical federated learning
    Zheng, Zhaohua
    Hong, Yiming
    Xie, Xin
    Li, Keqiu
    Chen, Qiquan
    SOFTWARE-PRACTICE & EXPERIENCE, 2024,