Joint Job Assignment and Resource Allocation for Multi-Job Wireless Federated Learning

被引:0
|
作者
Li, Tan [1 ]
Wei, Zeheng [1 ]
Liu, Hai [1 ]
Lin, Zhiyong [2 ]
Chan, Tse-Tin [3 ]
机构
[1] Hang Seng Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
[2] Guangdong Polytech Normal Univ, Sch Comp Sci, Guangzhou, Peoples R China
[3] Educ Univ Hong Kong, Dept Math & Informat Technol, Hong Kong, Peoples R China
关键词
Learning efficiency; multi-job optimization; resource allocation; system efficiency; wireless federated learning; OPTIMIZATION; INTERNET;
D O I
10.1109/MASS62177.2024.00062
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Wireless Federated Learning (WFL) marks a significant evolution in edge artificial intelligence (AI), allowing for collaborative learning while preserving the privacy of edge devices. Recently, the enhanced data collection and storage capability of edge devices have precipitated a paradigm shift from training an individual model (single-job) to multiple AI models (multi-job). This shift poses a new challenge in maintaining high system performance while managing resource management among multiple jobs. In this work, we address the challenge of a multi-job WFL framework by optimizing its dual efficiency. We formulate a multi-objective optimization problem with the goal of minimizing energy consumption and execution time to enhance system efficiency, while ensuring that all AI jobs meet their predefined performance criteria, thereby guaranteeing learning efficiency. To solve the problem, we propose an algorithm that jointly optimizes job assignment and resource allocation, by considering the triple-heterogeneity of data, devices, and jobs in the multi-job WFL framework. Specifically, a matching game-based method is utilized to assign jobs to capable devices, considering their respective contributions and costs, while convex optimization techniques are employed to refine the resource allocation toward computing frequency and transmission power. The performance of the algorithm is evaluated through numerical simulations in terms of system and learning performance over multiple AI model training jobs, showing that our proposed algorithm ensures time and energy efficiency under the same learning performance constraints.
引用
收藏
页码:419 / 427
页数:9
相关论文
共 50 条
  • [1] Efficient Device Scheduling with Multi-Job Federated Learning
    Zhou, Chendi
    Liu, Ji
    Jia, Juncheng
    Zhou, Jingbo
    Zhou, Yang
    Dai, Huaiyu
    Dou, Dejing
    THIRTY-SIXTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE / THIRTY-FOURTH CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE / TWELVETH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2022, : 9971 - 9979
  • [2] Efficient multi-job federated learning scheduling with fault tolerance
    Fu, Boqian
    Chen, Fahao
    Pan, Shengli
    Li, Peng
    Su, Zhou
    PEER-TO-PEER NETWORKING AND APPLICATIONS, 2025, 18 (02)
  • [3] Multi-Job Intelligent Scheduling With Cross-Device Federated Learning
    Liu, Ji
    Jia, Juncheng
    Ma, Beichen
    Zhou, Chendi
    Zhou, Jingbo
    Zhou, Yang
    Dai, Huaiyu
    Dou, Dejing
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (02) : 535 - 551
  • [4] Equilibrium multi-job assignment problem and genetic algorithm
    Liu, Linzhong
    Proceedings of the Fifth International Conference on Information and Management Sciences, 2006, 5 : 470 - 479
  • [5] DUE-DATE ASSIGNMENT TO MULTI-JOB CUSTOMER ORDERS
    BAGCHI, U
    JULIEN, FM
    MAGAZINE, MJ
    MANAGEMENT SCIENCE, 1994, 40 (10) : 1389 - 1392
  • [6] Multi-Job Multi-Edge Allocation in Edge Computing Environments
    Li, Shihao
    Miao, Weiwei
    Zeng, Zeng
    Wei, Lei
    Jiang, Chengling
    Wang, Chuanjun
    Zhang, Mingxuan
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [7] Fuzzy weighted equilibrium multi-job assignment problem and genetic algorithm
    Liu, Linzhong
    Gao, Xin
    APPLIED MATHEMATICAL MODELLING, 2009, 33 (10) : 3926 - 3935
  • [8] On Efficiency of Multi-job Grid Allocation Based on Statistical Trace Data
    Gábor Bacsó
    Ádám Visegrádi
    Attila Kertesz
    Zsolt Németh
    Journal of Grid Computing, 2014, 12 : 169 - 186
  • [9] On Efficiency of Multi-job Grid Allocation Based on Statistical Trace Data
    Bacso, Gabor
    Visegradi, Adam
    Kertesz, Attila
    Nemeth, Zsolt
    JOURNAL OF GRID COMPUTING, 2014, 12 (01) : 169 - 186
  • [10] Self-Learning MapReduce Scheduler in Multi-job Environment
    Lin, Changhang
    Guo, Wenzhong
    Lin, Changhui
    2013 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING AND BIG DATA (CLOUDCOM-ASIA), 2013, : 610 - 612