Joint Job Assignment and Resource Allocation for Multi-Job Wireless Federated Learning

被引:0
|
作者
Li, Tan [1 ]
Wei, Zeheng [1 ]
Liu, Hai [1 ]
Lin, Zhiyong [2 ]
Chan, Tse-Tin [3 ]
机构
[1] Hang Seng Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[3] Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Peoples R China
关键词
Learning efficiency; multi-job optimization; resource allocation; system efficiency; wireless federated learning; OPTIMIZATION; INTERNET;
D O I
10.1109/MASS62177.2024.00062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wireless Federated Learning (WFL) marks a significant evolution in edge artificial intelligence (AI), allowing for collaborative learning while preserving the privacy of edge devices. Recently, the enhanced data collection and storage capability of edge devices have precipitated a paradigm shift from training an individual model (single-job) to multiple AI models (multi-job). This shift poses a new challenge in maintaining high system performance while managing resource management among multiple jobs. In this work, we address the challenge of a multi-job WFL framework by optimizing its dual efficiency. We formulate a multi-objective optimization problem with the goal of minimizing energy consumption and execution time to enhance system efficiency, while ensuring that all AI jobs meet their predefined performance criteria, thereby guaranteeing learning efficiency. To solve the problem, we propose an algorithm that jointly optimizes job assignment and resource allocation, by considering the triple-heterogeneity of data, devices, and jobs in the multi-job WFL framework. Specifically, a matching game-based method is utilized to assign jobs to capable devices, considering their respective contributions and costs, while convex optimization techniques are employed to refine the resource allocation toward computing frequency and transmission power. The performance of the algorithm is evaluated through numerical simulations in terms of system and learning performance over multiple AI model training jobs, showing that our proposed algorithm ensures time and energy efficiency under the same learning performance constraints.
引用
收藏
页码:419 / 427
页数:9
相关论文
共 50 条
  • [31] Adaptive job scheduling via predictive job resource allocation
    Barsanti, Lawrence
    Sodan, Angela C.
    JOB SCHEDULING STRATEGIES FOR PARALLEL PROCESSING, 2007, 4376 : 115 - +
  • [32] Joint Mode Selection and Resource Allocation for D2D-Assisted Wireless Federated Learning
    Chen, Yifan
    Liu, Shengli
    IEEE WIRELESS COMMUNICATIONS LETTERS, 2025, 14 (01) : 78 - 82
  • [33] Joint User Association and Resource Allocation for Wireless Hierarchical Federated Learning with Non-IID Data
    Liu, Shengli
    Yu, Guanding
    Chen, Xianfu
    Bennis, Mehdi
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 74 - 79
  • [34] Joint Resource Management and Model Compression for Wireless Federated Learning
    Chen, Mingzhe
    Shlezinger, Nir
    Poor, H. Vincent
    Eldar, Yonina C.
    Cui, Shuguang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [35] A note on due-date assignment scheduling with job-dependent learning effects and convex resource allocation
    Lu, Yuan-Yuan
    Wang, Ting-Ting
    Wang, Rui-Qi
    Li, Yang
    ENGINEERING OPTIMIZATION, 2021, 53 (07) : 1273 - 1281
  • [36] Due-date assignment scheduling involving job-dependent learning effects and convex resource allocation
    Liu, Weiwei
    Jiang, Chong
    ENGINEERING OPTIMIZATION, 2020, 52 (01) : 74 - 89
  • [37] Resource allocation in wireless networks with federated learning: Network adaptability and learning acceleration
    Lee, Hyun-Suk
    Lee, Da-Eun
    ICT EXPRESS, 2022, 8 (01): : 31 - 36
  • [38] Joint Resource Allocation and Learning Optimization for UAV-Assisted Federated Learning
    Liu, Chaoyi
    Zhu, Qi
    APPLIED SCIENCES-BASEL, 2023, 13 (06):
  • [39] A new model for fuzzy multi-worker and multi-job position assignment problem associated with a penalty by applying IWDs algorithms
    Mahin Esmaeili
    Soft Computing, 2023, 27 : 5205 - 5216
  • [40] Multi-job Merging Framework and Scheduling Optimization for Apache Flink
    Ji, Hangxu
    Wu, Gang
    Zhao, Yuhai
    Yuan, Ye
    Wang, Guoren
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT I, 2021, 12681 : 20 - 36