FedFAIM: A Model Performance-Based Fair Incentive Mechanism for Federated Learning

被引:15
作者
Shi, Zhuan [1 ]
Zhang, Lan [1 ]
Yao, Zhenyu [2 ]
Lyu, Lingjuan [3 ]
Chen, Cen [4 ]
Wang, Li [5 ]
Wang, Junhao [1 ]
Li, Xiang-Yang [1 ]
机构
[1] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230027, Anhui, Peoples R China
[2] Univ Liverpool, Dept Math Sci, Liverpool L69 3BX, England
[3] Sony AI, Tokyo 1080075, Japan
[4] East China Normal Univ, Sch Data Sci & Engn, Shanghai 200000, Peoples R China
[5] Ant Financial, AI Dept, Hangzhou 310000, Zhejiang, Peoples R China
基金
国家重点研发计划;
关键词
Computational modeling; Resource management; Servers; Training; Collaborative work; Particle measurements; Atmospheric measurements; Federated learning; incentive mechanism; fairness; REPUTATION;
D O I
10.1109/TBDATA.2022.3183614
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Federated Learning (FL) has emerged as a privacy-preserving distributed machine learning paradigm. To motivate data owners to contribute towards FL, research on FL incentive mechanisms is gaining great interest. Existing monetary incentive mechanisms generally share the same FL model with all participants regardless of their contributions. Such an assumption can be unfair towards participants who contributed more and promote undesirable free-riding, especially when the final model is of great utility value to participants. In this paper, we propose a Fairness-Aware Incentive Mechanism for federated learning (FedFAIM) to address such problem. It satisfies two types of fairness notion: 1) aggregation fairness, which determines aggregation results according to data quality; 2) reward fairness, which assigns each participant a unique model with performance reflecting his contribution. Aggregation fairness is achieved through efficient gradient aggregation which examines local gradient quality and aggregates them based on data quality. Reward fairness is achieved through an efficient Shapley value-based contribution assessment method and a novel reward allocation method based on reputation and distribution of local and global gradients. We further prove reward fairness is theoretically guaranteed. Extensive experiments show that FedFAIM provides stronger incentives than similar non-monetary FL incentive mechanisms while achieving a high level of fairness.
引用
收藏
页码:1038 / 1050
页数:13
相关论文
共 37 条
  • [1] Bolton P., 2004, Contract Theory.
  • [2] Chen Y., 2015, Convolutional neural network for sentence classification
  • [4] Generative Adversarial Networks An overview
    Creswell, Antonia
    White, Tom
    Dumoulin, Vincent
    Arulkumaran, Kai
    Sengupta, Biswa
    Bharath, Anil A.
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) : 53 - 65
  • [5] Ghorbani A, 2019, PR MACH LEARN RES, V97
  • [6] On the need for a reputation system in mobile phone based sensing
    Huang, Kuan Lun
    Kanhere, Salil S.
    Hu, Wen
    [J]. AD HOC NETWORKS, 2014, 12 : 130 - 149
  • [7] Software Defined Networking for Energy Harvesting Internet of Things
    Huang, Xumin
    Yu, Rong
    Kang, Jiawen
    Xia, Zhuoquan
    Zhang, Yan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2018, 5 (03): : 1389 - 1399
  • [8] Jia R., 2019, 22 INT C ARTIFICIAL, P1167
  • [9] Advances and Open Problems in Federated Learning
    Kairouz, Peter
    McMahan, H. Brendan
    Avent, Brendan
    Bellet, Aurelien
    Bennis, Mehdi
    Bhagoji, Arjun Nitin
    Bonawitz, Kallista
    Charles, Zachary
    Cormode, Graham
    Cummings, Rachel
    D'Oliveira, Rafael G. L.
    Eichner, Hubert
    El Rouayheb, Salim
    Evans, David
    Gardner, Josh
    Garrett, Zachary
    Gascon, Adria
    Ghazi, Badih
    Gibbons, Phillip B.
    Gruteser, Marco
    Harchaoui, Zaid
    He, Chaoyang
    He, Lie
    Huo, Zhouyuan
    Hutchinson, Ben
    Hsu, Justin
    Jaggi, Martin
    Javidi, Tara
    Joshi, Gauri
    Khodak, Mikhail
    Konecny, Jakub
    Korolova, Aleksandra
    Koushanfar, Farinaz
    Koyejo, Sanmi
    Lepoint, Tancrede
    Liu, Yang
    Mittal, Prateek
    Mohri, Mehryar
    Nock, Richard
    Ozgur, Ayfer
    Pagh, Rasmus
    Qi, Hang
    Ramage, Daniel
    Raskar, Ramesh
    Raykova, Mariana
    Song, Dawn
    Song, Weikang
    Stich, Sebastian U.
    Sun, Ziteng
    Suresh, Ananda Theertha
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2021, 14 (1-2): : 1 - 210
  • [10] Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory
    Kang, Jiawen
    Xiong, Zehui
    Niyato, Dusit
    Xie, Shengli
    Zhang, Junshan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06) : 10700 - 10714