Incentivizing Federated Learning Under Long-Term Energy Constraint via Online Randomized Auctions

被引:19
作者
Yuan, Yulan [1 ]
Jiao, Lei [2 ]
Zhu, Konglin [1 ,3 ]
Zhang, Lin [1 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Artificial Intelligence, Beijing 100876, Peoples R China
[2] Univ Oregon, Dept Comp & Informat Sci, Eugene, OR 97403 USA
[3] Purple Mt Labs, Nanjing 210023, Peoples R China
基金
美国国家科学基金会;
关键词
Collaborative work; Computational modeling; Data models; Costs; Mobile handsets; Biological system modeling; Wireless communication; Federated learning; energy constraint; incentive mechanism; OPTIMIZATION APPROACH; NETWORKS; CONVERGENCE; MECHANISM; PRIVACY; DESIGN;
D O I
10.1109/TWC.2021.3137024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Mobile users are often reluctant to participate in federated learning to train models, due to the excessive consumption of the limited resources such as the mobile devices' energy. We propose an auction-based online incentive mechanism, FLORA, which allows users to submit bids dynamically and repetitively and compensates such bids subject to each user's long-term battery capacity. We formulate a nonlinear mixed-integer program to capture the social cost minimization in the federated learning system. Then we design multiple polynomial-time online algorithms, including a fractional online algorithm and a randomized rounding algorithm to select winning bids and control training accuracy, as well as a payment allocation algorithm to calculate the remuneration based on the bid-winning probabilities. Maintaining the satisfiable quality of the global model that is trained, our approach works on the fly without relying on the unknown future inputs, and achieves provably a sublinear regret and a sublinear fit over time while attaining the economic properties of truthfulness and individual rationality in expectation. Extensive trace-driven evaluations have confirmed the practical superiority of FLORA over existing alternatives.
引用
收藏
页码:5129 / 5144
页数:16
相关论文
共 45 条
[11]   Joint Service Pricing and Cooperative Relay Communication for Federated Learning [J].
Feng, Shaohan ;
Niyato, Dusit ;
Wang, Ping ;
Kim, Dong In ;
Liang, Ying-Chang .
2019 INTERNATIONAL CONFERENCE ON INTERNET OF THINGS (ITHINGS) AND IEEE GREEN COMPUTING AND COMMUNICATIONS (GREENCOM) AND IEEE CYBER, PHYSICAL AND SOCIAL COMPUTING (CPSCOM) AND IEEE SMART DATA (SMARTDATA), 2019, :815-820
[12]  
Gao X., 2019, AUST J MATH ANAL APP, V16, P1
[13]   Online Convex Optimization in Dynamic Environments [J].
Hall, Eric C. ;
Willett, Rebecca M. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2015, 9 (04) :647-662
[14]   Toward an Automated Auction Framework for Wireless Federated Learning Services Market [J].
Jiao, Yutao ;
Wang, Ping ;
Niyato, Dusit ;
Lin, Bin ;
Kim, Dong In .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (10) :3034-3048
[15]   Resource-Efficient and Convergence-Preserving Online Participant Selection in Federated Learning [J].
Jin, Yibo ;
Jiao, Lei ;
Qian, Zhuzhong ;
Zhang, Sheng ;
Lu, Sanglu ;
Wang, Xiaoliang .
2020 IEEE 40TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING SYSTEMS (ICDCS), 2020, :606-616
[16]  
Kaelbling L. P., 2018, PROC ADV NEURAL INF, P1
[17]   Incentive Mechanism for Reliable Federated Learning: A Joint Optimization Approach to Combining Reputation and Contract Theory [J].
Kang, Jiawen ;
Xiong, Zehui ;
Niyato, Dusit ;
Xie, Shengli ;
Zhang, Junshan .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (06) :10700-10714
[18]  
Konecny J., 2016, CORR
[19]   An Incentive Mechanism for Federated Learning in Wireless Cellular Networks: An Auction Approach [J].
Le, Tra Huong Thi ;
Tran, Nguyen H. ;
Tun, Yan Kyaw ;
Nguyen, Minh N. H. ;
Pandey, Shashi Raj ;
Han, Zhu ;
Hong, Choong Seon .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (08) :4874-4887
[20]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324